-- Logs begin at Fri 2021-09-03 10:38:50 UTC, end at Fri 2021-09-03 11:52:21 UTC. -- Sep 03 11:21:35.825679 dv-cinder-760199-12-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Sep 03 11:21:38.575302 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.common.config [-] Logging enabled! Sep 03 11:21:38.575838 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev608 Sep 03 11:21:38.576179 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=94287) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 03 11:21:38.579462 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.common.config [-] Logging enabled! Sep 03 11:21:38.579713 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev608 Sep 03 11:21:38.580020 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=94287) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 03 11:21:38.581198 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 11:21:38.581425 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 11:21:38.581778 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 11:21:38.582020 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 11:21:38.582240 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 11:21:38.582578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.582868 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.583156 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.583382 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.583671 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.583954 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.584230 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.584512 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.584801 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.585081 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.585355 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.585634 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.585859 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.586135 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] config_source = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.586437 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.586721 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.586946 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] debug = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.587221 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.587639 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.588041 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.588321 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.588607 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.588882 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.589152 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.589425 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.589706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.590027 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] host = dv-cinder-760199-12-iscsi {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.590301 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.590609 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.590893 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.591838 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.592147 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.592410 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.592694 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.592966 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_dir = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.593237 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.593512 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.593800 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.594085 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.594370 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.594612 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.594830 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.595115 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.595398 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.595672 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.595945 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.596219 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.596490 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.596761 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.597027 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.597307 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.597592 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.597874 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.598148 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.598447 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.598718 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.598987 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.599266 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.599536 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.599808 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.600078 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.600360 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.600625 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.600895 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.601186 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.601465 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.601740 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.602019 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.602290 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.602590 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.602860 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.603127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_journal = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.603394 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_json = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.603662 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.603927 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.604202 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.604469 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.604735 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.605002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.605268 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.605546 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:38.605837 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.606127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.606449 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.606731 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.607813 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.608094 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.608381 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.608657 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.608941 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.609225 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.609510 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.609783 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.610065 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.610339 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.610656 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.610958 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.611248 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.611534 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.611894 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.612173 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.612447 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.612723 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.613013 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.613287 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.613572 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.613855 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.614131 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.614449 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.614741 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.615039 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.615299 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.615574 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.615860 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.616132 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.616401 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.616675 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.616959 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.617232 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.617501 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.617776 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.618051 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.618319 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.618612 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.618886 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.619171 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.619442 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.619706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.619971 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.620241 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.620508 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.620785 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.621055 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.621323 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.621591 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.621864 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.622134 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.622569 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.622871 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.623143 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.623420 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.623689 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.623958 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.624227 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.624497 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.624764 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.625030 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.625298 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.625570 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.625838 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.626102 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.626369 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.626657 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.626924 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.627207 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.627501 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.627773 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.628048 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.628319 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.628592 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.628861 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.629129 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.629402 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.629673 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.629938 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.630219 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.630525 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.630807 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.631083 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.631355 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.631649 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.631922 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.632199 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.632471 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.632744 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.633020 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.633297 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.633582 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.633865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.634148 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.634453 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.634743 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.635021 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.635321 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.635594 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:38.635806 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 11:21:38.636039 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=94287) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Sep 03 11:21:38.987356 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=94287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 03 11:21:38.987635 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=94287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 03 11:21:38.987917 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=94287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 03 11:21:38.988242 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [-] Loading core plugin: ml2 Sep 03 11:21:39.379968 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.380176 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.380450 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.381732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.382002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.382262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.417634 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.417926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.418191 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.433631 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.433906 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.434170 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.462324 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.462624 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.462891 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.501284 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.501559 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.501827 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.730679 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.731311 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.731311 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.731477 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.732174 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.852922 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.853238 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.853518 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.853785 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.854045 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.854347 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.854629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.854876 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.855123 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.855397 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.855647 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.855901 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.856149 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.856392 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.856639 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.856918 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.857165 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.857425 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.857685 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.857934 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.858203 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.858472 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.858750 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.859120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.859364 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.859604 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.859990 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.860225 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.860458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.860688 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.860919 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.861149 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:39.861503 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Sep 03 11:21:39.864602 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Sep 03 11:21:39.868479 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Sep 03 11:21:39.872242 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(350, 399)])]) Sep 03 11:21:39.874017 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Sep 03 11:21:39.874487 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Sep 03 11:21:39.874821 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Sep 03 11:21:39.875203 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Sep 03 11:21:39.877935 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Sep 03 11:21:39.878183 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Sep 03 11:21:39.878559 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Sep 03 11:21:39.883781 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Sep 03 11:21:39.906109 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Sep 03 11:21:39.906572 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.906870 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=94287) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Sep 03 11:21:39.907229 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.908563 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=94287) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Sep 03 11:21:39.908841 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Sep 03 11:21:39.909084 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Sep 03 11:21:39.912413 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.912693 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:39.976750 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Sep 03 11:21:39.976983 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Sep 03 11:21:39.977214 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Sep 03 11:21:39.977575 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Sep 03 11:21:39.999781 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_db.sqlalchemy.engines [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 11:21:40.827741 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing driver for type 'gre' Sep 03 11:21:40.828399 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] gre ID ranges: [(1, 1000)] Sep 03 11:21:41.004874 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing driver for type 'local' Sep 03 11:21:41.005203 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing driver for type 'vlan' Sep 03 11:21:41.170762 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] VlanTypeDriver initialization complete Sep 03 11:21:41.171101 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing driver for type 'vxlan' Sep 03 11:21:41.171638 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] vxlan ID ranges: [(1, 1000)] Sep 03 11:21:41.364932 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing extension driver 'port_security' Sep 03 11:21:41.365275 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.extensions.port_security [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] PortSecurityExtensionDriver initialization complete Sep 03 11:21:41.365605 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing mechanism driver 'openvswitch' Sep 03 11:21:41.365937 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing mechanism driver 'hyperv' Sep 03 11:21:41.376216 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.plugin [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=94287) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:41.376902 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.377275 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.377621 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.378139 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.378594 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.378948 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.379292 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.379690 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.380097 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.380446 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.380805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.381179 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.381583 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.381931 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.382269 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.382834 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.383241 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.383592 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.383964 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.384359 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.384761 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > address_group after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.385105 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > address_group after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.385443 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > address_group after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.385832 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=94287) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 03 11:21:41.386218 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] ML2 OVO RPC backend initialized. {{(pid=94287) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Sep 03 11:21:41.386952 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.387306 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.387723 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.388772 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > networks before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.389127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.389468 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > ports before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.389810 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.390156 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnets before_response 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.390533 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.390871 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.391205 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.391539 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.391873 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.392206 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.392541 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.392875 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.393205 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > subnet after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.393789 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.plugin [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Modular L2 Plugin initialization complete Sep 03 11:21:41.394120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading services supported by the core plugin {{(pid=94287) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Sep 03 11:21:41.394473 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.plugins.ml2.managers [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Got port-security extension from driver 'port_security' Sep 03 11:21:41.394942 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.extensions.vlantransparent [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Disabled vlantransparent extension. Sep 03 11:21:41.395424 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=94287) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Sep 03 11:21:41.395737 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: router Sep 03 11:21:41.432093 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.432434 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_create 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.432805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router before_create 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.433169 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.433543 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.433899 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_delete 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.434256 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > floatingip after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.434630 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > floatingip after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.436075 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_create 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.436434 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.436790 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.437166 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.437529 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.437944 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.438318 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.438688 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.439030 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: subnet after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.439373 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.439729 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > port precommit_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.440078 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_create 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.440424 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.440768 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.441129 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router after_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.441472 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_delete 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.441827 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_create 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.442195 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router_interface after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.442578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_update 55549900 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.442946 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > agent after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.443298 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > agent after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.443644 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > network after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.444525 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Tracking information for resource: router configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:41.444861 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Tracking information for resource: floatingip configured {{(pid=94287) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 03 11:21:41.449871 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.db.l3_agentschedulers_db [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Sep 03 11:21:41.451092 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.451465 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.451818 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.452171 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: port after_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.452973 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router before_create 55550100 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.453336 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_delete 55550100 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.453695 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_create 55550100 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.454051 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > router precommit_update 55550100 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.459117 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.provider_configuration [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service providers = [] {{(pid=94287) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Sep 03 11:21:41.459486 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.db.servicetype_db [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=94287) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Sep 03 11:21:41.462482 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.service_base [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=94287) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 03 11:21:41.462838 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.service_base [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=94287) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 03 11:21:41.463183 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.service_base [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=94287) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 03 11:21:41.464076 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.services.service_base [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=94287) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 03 11:21:41.464448 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.services.service_base [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Default provider is not specified for service type L3_ROUTER_NAT Sep 03 11:21:41.464822 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.465138 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Sep 03 11:21:41.475908 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded METERING plugin. Description: METERING {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.476243 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: auto_allocate Sep 03 11:21:41.482028 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: network precommit_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.482423 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: network precommit_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.482947 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.483267 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: tag Sep 03 11:21:41.489752 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.490080 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: timestamp Sep 03 11:21:41.494108 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.502413 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: network_ip_availability Sep 03 11:21:41.507844 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.508218 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.508568 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.509305 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.509622 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: flavors Sep 03 11:21:41.515113 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.515441 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading Plugin: revisions Sep 03 11:21:41.519773 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=94287) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 03 11:21:41.520156 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.532s {{(pid=94287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 03 11:21:41.520894 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=94287) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} Sep 03 11:21:41.521224 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Initializing extension manager. Sep 03 11:21:41.521730 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: __init__.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.522068 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: __pycache__ {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.522421 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.522754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: address_group.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.523565 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.524144 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: address-group Sep 03 11:21:41.524461 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: address_scope.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.525368 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.525870 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: address-scope Sep 03 11:21:41.526188 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: admin_state_down_before_update.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.527143 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.527643 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: router-admin-state-down-before-update Sep 03 11:21:41.527960 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: agent.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.528810 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.529190 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: agent Sep 03 11:21:41.529481 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: agent_resources_synced.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.536372 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.536872 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: agent-resources-synced Sep 03 11:21:41.537190 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: allowedaddresspairs.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.539025 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.539541 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: allowed-address-pairs Sep 03 11:21:41.539861 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: auto_allocated_topology.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.540986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.541488 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: auto-allocated-topology Sep 03 11:21:41.541810 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: availability_zone.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.542531 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.543023 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: availability_zone Sep 03 11:21:41.543339 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: availability_zone_filter.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.544250 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.544918 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: availability_zone_filter Sep 03 11:21:41.545290 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: data_plane_status.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.546192 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.546722 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension data-plane-status not supported by any of loaded plugins Sep 03 11:21:41.547038 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: default_subnetpools.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.547947 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.548444 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: default-subnetpools Sep 03 11:21:41.548890 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: dhcpagentscheduler.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.549630 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.550130 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: dhcp_agent_scheduler Sep 03 11:21:41.550476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: dns.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.551392 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.551891 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension dns-integration not supported by any of loaded plugins Sep 03 11:21:41.552208 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: dns_domain_ports.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.553131 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.553631 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension dns-domain-ports not supported by any of loaded plugins Sep 03 11:21:41.553949 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.554898 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.555397 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Sep 03 11:21:41.555814 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: dvr.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.556483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.556982 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: dvr Sep 03 11:21:41.557297 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: ecmp_routes.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.558202 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.558731 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension ecmp_routes not supported by any of loaded plugins Sep 03 11:21:41.559047 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: empty_string_filtering.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.560613 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.561117 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: empty-string-filtering Sep 03 11:21:41.561429 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.562337 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.562864 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Sep 03 11:21:41.563183 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.564093 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.564595 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Sep 03 11:21:41.564917 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: external_net.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.565820 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.566316 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: external-net Sep 03 11:21:41.566655 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: extra_dhcp_opt.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.567552 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.568050 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: extra_dhcp_opt Sep 03 11:21:41.568363 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: extraroute.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.569261 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.569756 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: extraroute Sep 03 11:21:41.570074 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: extraroute_atomic.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.571123 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.571624 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: extraroute-atomic Sep 03 11:21:41.571942 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: filter_validation.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.572602 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.573096 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: filter-validation Sep 03 11:21:41.573413 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: fip_pf_description.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.574312 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.574841 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Sep 03 11:21:41.575158 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: fip_port_details.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.576602 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.577098 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: fip-port-details Sep 03 11:21:41.577416 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: flavors.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.578729 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.585236 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: flavors Sep 03 11:21:41.585236 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.586743 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.587260 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Sep 03 11:21:41.587592 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: floatingip_pools.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.588294 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.588798 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: floatingip-pools Sep 03 11:21:41.589120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: ip_allocation.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.590056 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.590584 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension ip_allocation not supported by any of loaded plugins Sep 03 11:21:41.590907 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: ip_substring_port_filtering.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.591918 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.592421 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: ip-substring-filtering Sep 03 11:21:41.592745 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l2_adjacency.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.593675 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.594172 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension l2_adjacency not supported by any of loaded plugins Sep 03 11:21:41.594530 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.595619 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.596135 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: router Sep 03 11:21:41.596456 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3_conntrack_helper.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.598794 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.599317 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension l3-conntrack-helper not supported by any of loaded plugins Sep 03 11:21:41.599642 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3_ext_gw_mode.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.600652 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.601151 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: ext-gw-mode Sep 03 11:21:41.601475 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3_ext_ha_mode.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.602429 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.602934 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: l3-ha Sep 03 11:21:41.603255 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3_flavors.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.604165 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.604663 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: l3-flavors Sep 03 11:21:41.604981 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.605886 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.606405 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: l3-port-ip-change-not-allowed Sep 03 11:21:41.606755 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: l3agentscheduler.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.607795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.608294 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: l3_agent_scheduler Sep 03 11:21:41.608615 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: logging.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.610078 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.610618 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension logging not supported by any of loaded plugins Sep 03 11:21:41.610945 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: metering.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.611690 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.612255 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: metering Sep 03 11:21:41.612574 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.613652 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.614163 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: metering_source_and_destination_fields Sep 03 11:21:41.614519 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: multiprovidernet.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.615441 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.615944 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: multi-provider Sep 03 11:21:41.616263 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: netmtu.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.617171 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.617674 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: net-mtu Sep 03 11:21:41.617991 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: netmtu_writable.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.625962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.626632 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: net-mtu-writable Sep 03 11:21:41.626959 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: network_availability_zone.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.627631 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.628127 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: network_availability_zone Sep 03 11:21:41.628443 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: network_ip_availability.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.629537 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.630039 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: network-ip-availability Sep 03 11:21:41.630360 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: network_segment_range.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.631153 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.631649 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension network-segment-range not supported by any of loaded plugins Sep 03 11:21:41.631968 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: pagination.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.632996 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.633322 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: pagination Sep 03 11:21:41.633640 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: port_device_profile.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.634593 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.635103 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: port-device-profile Sep 03 11:21:41.635417 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: port_mac_address_regenerate.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.636340 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.636850 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: port-mac-address-regenerate Sep 03 11:21:41.637227 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: port_numa_affinity_policy.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.638727 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.639236 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: port-numa-affinity-policy Sep 03 11:21:41.639553 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: port_resource_request.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.640602 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.641104 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension port-resource-request not supported by any of loaded plugins Sep 03 11:21:41.641420 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: portbindings.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.642346 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.642876 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: binding Sep 03 11:21:41.643231 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: portbindings_extended.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.644497 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.645005 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: binding-extended Sep 03 11:21:41.645329 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: portsecurity.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.646237 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.646771 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: port-security Sep 03 11:21:41.647091 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: project_id.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.648068 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.648394 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: project-id Sep 03 11:21:41.648712 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: providernet.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.649617 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.650122 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: provider Sep 03 11:21:41.650467 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.654468 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.655049 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos not supported by any of loaded plugins Sep 03 11:21:41.655376 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_bw_limit_direction.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.660270 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.660782 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Sep 03 11:21:41.661111 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.662027 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.662559 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Sep 03 11:21:41.662884 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_default.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.663793 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.664292 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-default not supported by any of loaded plugins Sep 03 11:21:41.664616 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_fip.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.665261 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.665752 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-fip not supported by any of loaded plugins Sep 03 11:21:41.666070 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_gateway_ip.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.667062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.667567 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-gateway-ip not supported by any of loaded plugins Sep 03 11:21:41.667886 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_port_network_policy.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.668797 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.669908 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-port-network-policy not supported by any of loaded plugins Sep 03 11:21:41.670294 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_pps_rule.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.671483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.671996 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-pps not supported by any of loaded plugins Sep 03 11:21:41.672318 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_rule_type_details.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.673247 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.673777 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-rule-type-details not supported by any of loaded plugins Sep 03 11:21:41.674098 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: qos_rules_alias.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.675164 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.675665 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension qos-rules-alias not supported by any of loaded plugins Sep 03 11:21:41.675984 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: quotasv2.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.676888 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.677208 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: quotas Sep 03 11:21:41.677522 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: quotasv2_detail.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.680877 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.681214 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: quota_details Sep 03 11:21:41.681539 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: rbac.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.682678 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.683148 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: rbac-policies Sep 03 11:21:41.683471 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: rbac_address_group.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.684400 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.684937 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: rbac-address-group Sep 03 11:21:41.685258 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: rbac_address_scope.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.686218 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.686750 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: rbac-address-scope Sep 03 11:21:41.687073 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: rbac_security_groups.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.687988 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.688491 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: rbac-security-groups Sep 03 11:21:41.688811 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: rbac_subnetpool.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.689719 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.690231 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: rbac-subnetpool Sep 03 11:21:41.690577 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: revisionifmatch.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.691497 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.692050 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: revision-if-match Sep 03 11:21:41.692369 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: revisions.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.693475 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.693979 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: standard-attr-revisions Sep 03 11:21:41.694303 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: router_availability_zone.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.695002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.695506 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: router_availability_zone Sep 03 11:21:41.695824 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: routerservicetype.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.696747 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.697251 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension router-service-type not supported by any of loaded plugins Sep 03 11:21:41.697571 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.698520 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.699027 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: security-groups-normalized-cidr Sep 03 11:21:41.699345 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: security_groups_port_filtering.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.700262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.700853 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: port-security-groups-filtering Sep 03 11:21:41.701170 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: security_groups_remote_address_group.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.702081 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.702616 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: security-groups-remote-address-group Sep 03 11:21:41.702935 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: securitygroup.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.714074 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.714633 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: security-group Sep 03 11:21:41.714963 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: segment.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.715746 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.716864 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension segment not supported by any of loaded plugins Sep 03 11:21:41.717186 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.718124 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.718654 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Sep 03 11:21:41.718974 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: servicetype.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.720148 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.720662 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: service-type Sep 03 11:21:41.720984 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: sorting.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.721968 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.722298 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: sorting Sep 03 11:21:41.722643 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: standard_attr_segment.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.723561 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.724065 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension standard-attr-segment not supported by any of loaded plugins Sep 03 11:21:41.724383 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: standardattrdescription.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.725030 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.725532 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: standard-attr-description Sep 03 11:21:41.725854 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: stateful_security_group.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.726813 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.727327 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: stateful-security-group Sep 03 11:21:41.727648 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: stdattrs_common.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.728238 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Sep 03 11:21:41.728554 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.729492 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.730006 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Sep 03 11:21:41.730326 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnet_onboard.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.731446 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.732544 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: subnet_onboard Sep 03 11:21:41.732999 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnet_segmentid_writable.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.733928 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.734467 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Sep 03 11:21:41.734789 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnet_service_types.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.735715 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.736220 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: subnet-service-types Sep 03 11:21:41.736538 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnetallocation.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.737623 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.738118 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: subnet_allocation Sep 03 11:21:41.738459 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.739128 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.739629 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: subnetpool-prefix-ops Sep 03 11:21:41.739951 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.740875 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.741372 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Sep 03 11:21:41.741686 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: tagging.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.742788 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.743297 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: standard-attr-tag Sep 03 11:21:41.743618 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: timestamp.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.744833 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.745344 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loaded extension: standard-attr-timestamp Sep 03 11:21:41.745665 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: trunk.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.746751 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.747258 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension trunk not supported by any of loaded plugins Sep 03 11:21:41.747929 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: trunk_details.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.748923 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.750307 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension trunk-details not supported by any of loaded plugins Sep 03 11:21:41.750307 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: uplink_status_propagation.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.751401 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.751401 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension uplink-status-propagation not supported by any of loaded plugins Sep 03 11:21:41.751738 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Loading extension file: vlantransparent.py {{(pid=94287) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Sep 03 11:21:41.752310 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=94287) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Sep 03 11:21:41.752808 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extension vlan-transparent not supported by any of loaded plugins Sep 03 11:21:41.756607 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:network Sep 03 11:21:41.757488 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnet Sep 03 11:21:41.758159 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnetpool Sep 03 11:21:41.758896 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:port Sep 03 11:21:41.760972 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.761707 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service FLAVORS assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.762850 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.763440 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.763984 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:router Sep 03 11:21:41.764425 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:floatingip Sep 03 11:21:41.764932 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service METERING assigned prefix: /metering {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.766401 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.766794 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.767144 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94287) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:21:41.768171 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of CountableResource for resource:rbac_policy Sep 03 11:21:41.768610 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:security_group Sep 03 11:21:41.769043 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:security_group_rule Sep 03 11:21:41.769636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service CORE assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.769963 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnetpool Sep 03 11:21:41.770310 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] subnetpool is already registered Sep 03 11:21:41.770770 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service CORE assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.771092 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnetpool Sep 03 11:21:41.771420 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] subnetpool is already registered Sep 03 11:21:41.773748 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.774182 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service FLAVORS assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.774815 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.775236 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.775566 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:router Sep 03 11:21:41.775899 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] router is already registered Sep 03 11:21:41.776302 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:floatingip Sep 03 11:21:41.776632 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] floatingip is already registered Sep 03 11:21:41.777076 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service METERING assigned prefix: /metering {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.777744 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of CountableResource for resource:rbac_policy Sep 03 11:21:41.778068 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] rbac_policy is already registered Sep 03 11:21:41.778497 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:security_group Sep 03 11:21:41.779369 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] security_group is already registered Sep 03 11:21:41.779763 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:security_group_rule Sep 03 11:21:41.780094 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] security_group_rule is already registered Sep 03 11:21:41.780714 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service CORE assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.781038 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnetpool Sep 03 11:21:41.781367 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] subnetpool is already registered Sep 03 11:21:41.781792 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.v2.resource_helper [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Service CORE assigned prefix: {{(pid=94287) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 03 11:21:41.782111 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Creating instance of TrackedResource for resource:subnetpool Sep 03 11:21:41.782465 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING neutron.quota.resource_registry [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] subnetpool is already registered Sep 03 11:21:41.782924 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: extensions {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.784376 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: address-groups {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.785868 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: address-scopes {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.787224 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: agents {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.788375 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: auto-allocated-topology {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.789618 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: availability_zones {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.790873 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: dhcp-networks {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.792372 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: dhcp-agents {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.793788 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: routers {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.796728 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: flavors {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.797896 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: service_profiles {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.799138 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: next_providers {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.800591 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: service_profiles {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.802127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: floatingip-pools {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.803376 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: routers {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.805479 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: floatingips {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.806779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: l3-routers {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.808160 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: l3-agents {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.809574 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: metering-labels {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.811210 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: metering-label-rules {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.812485 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: network-ip-availabilities {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.813752 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: bindings {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.816233 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: quotas {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.817707 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: quotas {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.819162 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: rbac-policies {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.820374 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: security-groups {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.821665 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: security-group-rules {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.822942 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: service-providers {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.824168 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: subnetpools {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.826225 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: subnetpools {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.827770 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.829419 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.831601 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.833374 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.835188 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.837019 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.838728 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.840634 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.843103 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.844834 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron.api.extensions [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Extended resource: tags {{(pid=94287) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 03 11:21:41.850758 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING keystonemiddleware.auth_token [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 11:21:41.855493 dv-cinder-760199-12-iscsi neutron-server[94287]: WARNING keystonemiddleware.auth_token [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 11:21:41.864083 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Acquired lock "singleton_lock" {{(pid=94287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 03 11:21:41.864552 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_concurrency.lockutils [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Releasing lock "singleton_lock" {{(pid=94287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 03 11:21:41.865181 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Starting 2 workers Sep 03 11:21:41.870178 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Started child 94432 {{(pid=94287) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 03 11:21:41.874761 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Started child 94433 {{(pid=94287) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 03 11:21:41.875573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.876309 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO neutron.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Neutron service started, listening on 0.0.0.0:9696 Sep 03 11:21:41.877006 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Notify callbacks [] for process, before_spawn {{(pid=94287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.877157 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [-] (94432) wsgi starting up on http://0.0.0.0:9696 Sep 03 11:21:41.879465 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Starting 1 workers Sep 03 11:21:41.879621 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.880907 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [-] (94433) wsgi starting up on http://0.0.0.0:9696 Sep 03 11:21:41.884707 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Started child 94434 {{(pid=94287) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 03 11:21:41.885225 dv-cinder-760199-12-iscsi neutron-server[94287]: INFO oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Starting 1 workers Sep 03 11:21:41.889611 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] calling RpcWorker wait() {{(pid=94434) _wait /opt/stack/neutron/neutron/service.py:128}} Sep 03 11:21:41.890192 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] returning from RpcWorker wait() {{(pid=94434) _wait /opt/stack/neutron/neutron/service.py:135}} Sep 03 11:21:41.890277 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Started child 94435 {{(pid=94287) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 03 11:21:41.891120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG neutron_lib.callbacks.manager [None req-7542a3bf-5e98-4ce2-aefe-74208213ea0b None None] Notify callbacks [] for process, after_spawn {{(pid=94287) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.891721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.892229 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:41.892928 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=94287) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 03 11:21:41.893148 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 11:21:41.893329 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 11:21:41.893538 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 11:21:41.893881 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 11:21:41.894039 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 11:21:41.894578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.894862 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.895108 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.895206 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:41.895649 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.895649 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.896226 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.896456 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.896698 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.896957 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.897181 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.897350 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.897511 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.897766 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.898010 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.898301 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.898605 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.898846 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.899125 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.899294 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.899539 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_source = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.899799 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.900016 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.900271 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] debug = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.900511 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.900981 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.901219 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.901473 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.901681 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.901948 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.902182 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.902438 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.902677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.902885 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.903110 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.903374 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.903659 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.904400 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.904613 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.904877 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.905088 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.905588 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] host = dv-cinder-760199-12-iscsi {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.905846 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.906060 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.906315 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.906587 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.906835 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.907043 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.907306 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.907552 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.907797 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.908032 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.908287 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.908523 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.908750 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_dir = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.908975 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.909132 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_options = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.909346 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.909625 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.909891 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.910026 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.910191 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.910360 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.910643 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.910793 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.911015 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.911242 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.911450 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.911674 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.911912 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.912148 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.912406 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.912645 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.912852 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.913068 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.913326 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.913569 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.913801 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.914017 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.914247 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.914503 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.914736 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.914962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.915179 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.915529 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.915677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.915858 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.916091 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.916341 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.916568 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.916835 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.917056 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.917275 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.917480 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.917730 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.917953 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.918197 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.918454 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.918682 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.918917 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.919124 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.919400 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_journal = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.919611 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_json = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.919836 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.920062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.920316 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.920528 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.920756 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.920940 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.921147 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.921385 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.921823 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.922112 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.922424 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.922674 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.922906 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.923153 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.923376 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.923633 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.923910 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.924125 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.924446 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.924661 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.924966 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.925183 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.925460 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.925831 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.926048 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.926322 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.926560 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.926790 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.926957 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:41.927088 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.927210 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.927490 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.927712 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.927938 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.928196 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.928413 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.928739 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.929000 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.929263 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.16/identity {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.929526 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.929738 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.929956 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.930190 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.930432 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.930634 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.930863 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.931096 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.931313 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.931521 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.931760 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.932234 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.932234 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.932625 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.932625 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.932944 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.933091 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.933324 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.933534 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.933761 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.933978 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.934203 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.934445 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.934662 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.934974 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.935198 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.935417 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.935626 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.935833 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.936047 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.936320 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.936532 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.936739 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.936945 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.937155 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.937359 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.937597 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.937809 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.938017 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.938229 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.938462 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.938687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.938899 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.939109 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.939320 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.939535 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.940351 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.940982 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.941220 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.941668 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.942120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.942340 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.942600 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.942816 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.943024 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.944904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.944904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.944904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.944904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.944904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.945603 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.945603 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.945603 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.945603 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946166 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946166 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946585 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946585 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946996 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.946996 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.947369 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.947369 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.947631 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949084 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949577 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949577 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.949800 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.950055 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.951056 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.956962 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957476 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.957986 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958578 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958932 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.958932 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.959076 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.959305 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.16/identity {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.959522 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.959728 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.959967 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.960174 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.960411 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.960611 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.960872 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.961104 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.961315 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.961553 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.961782 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.962014 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.962241 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.962486 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.962701 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.962938 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.963152 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.963365 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.963596 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.963827 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.964040 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.964250 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.964488 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.964742 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.964971 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.965230 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.965481 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.965691 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.965916 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967108 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967108 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967321 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967546 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967764 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.967972 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.968179 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.968407 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.968623 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.968830 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.969047 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.969274 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.969505 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.969747 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.970099 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.970357 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.970629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.970855 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.971064 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.971300 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.971532 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.971745 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.971968 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.972179 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.972409 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.972661 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.972896 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.973128 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.973338 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.973543 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.973744 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.973954 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.974165 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.974507 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.974752 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.974976 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.975225 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.975456 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.975668 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.975908 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.976111 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.976315 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.976532 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.976742 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.976943 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.977162 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.977364 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.977567 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.977780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.977987 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.978189 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.978462 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.978667 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.978896 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.979110 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.979320 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.979542 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.979761 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.979960 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.980162 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.980374 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.980584 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.980786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.981012 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.981214 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.981415 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.981629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.981902 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.982171 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.982498 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.982744 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.982958 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.983237 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.983475 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.983712 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.983938 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.984248 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.984455 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.984688 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.984900 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.985111 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.985326 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.985595 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.985918 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.986197 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.986480 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.986726 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.986991 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.987262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.987513 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.987719 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.988026 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.988349 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.988609 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.988873 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.989099 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.989343 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.989575 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.989790 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.990041 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.990278 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.990509 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.990742 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.990970 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.991188 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.991420 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.991651 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.991889 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.992107 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.992329 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.992561 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.992786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:41.992938 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 11:21:41.993437 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=94287) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 03 11:21:41.993591 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 11:21:41.993739 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 11:21:41.993902 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 11:21:41.994067 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 11:21:41.994215 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 11:21:41.994472 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.994637 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.994790 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.995699 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996243 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996243 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996243 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996243 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996510 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996588 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996674 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996821 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.996979 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.997171 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.997315 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] config_source = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.997479 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] debug = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998002 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998235 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998235 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998429 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998583 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998670 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998810 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.998966 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999120 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999274 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999439 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999570 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999723 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:41.999876 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000066 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000173 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000324 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000477 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] host = dv-cinder-760199-12-iscsi {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000631 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000788 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.000942 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001094 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001246 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001399 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001550 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001703 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.001856 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002009 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002161 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002315 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002489 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_dir = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002644 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002797 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_options = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.002949 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003103 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003257 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003435 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003594 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003749 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.003904 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004059 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004214 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004368 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004532 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004665 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004813 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.004966 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.005119 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.005404 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.005583 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.005726 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.005878 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006021 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006159 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006297 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006489 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006774 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.006911 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007050 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007197 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007337 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007426 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007563 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007715 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.007869 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008023 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008176 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008329 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008486 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008663 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.008793 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009064 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57026) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:21:42.009187 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009263 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009412 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009567 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009708 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.009835 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_journal = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010173 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_json = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010338 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010522 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010657 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010815 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.010968 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.011124 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.011273 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.011427 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 11:21:42.011605 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.011766 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.011965 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012104 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012231 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012390 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012549 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012705 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.012858 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.013586 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.013762 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.013926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014086 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014301 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014421 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014571 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014739 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.014901 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015280 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015280 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015426 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015494 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015649 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015796 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.015946 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016088 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016230 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016409 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016559 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016721 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.16/identity {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.016874 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017017 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017158 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017319 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017470 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017613 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.017940 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018094 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018238 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018397 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018547 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018793 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.018888 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.019037 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020066 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020066 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020066 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020485 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [-] 10.222.0.16 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0081587 Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.020629 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.021696 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.021696 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.021696 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.021696 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.021696 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.022346 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.022554 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.022703 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.022862 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.023118 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024127 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.024805 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025661 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025661 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.025661 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.026636 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027059 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027059 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027059 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027272 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027350 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027497 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027663 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027802 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.027940 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.028088 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.028227 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.028364 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.028525 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.029396 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.029616 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.029767 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.029903 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.030041 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.030187 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.030336 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.030677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.030677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.032062 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.033262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.034291 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.035606 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.16/identity {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.036687 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.037706 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.038779 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.039786 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.040780 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.041754 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.042677 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.043458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.043458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.043458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.043458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.043458 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044052 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044052 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044052 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044052 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044471 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044471 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044471 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044753 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.044944 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045070 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045191 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045311 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045475 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045634 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045791 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.045948 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.046105 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.046262 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.047161 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.047319 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.047480 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.048926 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.050865 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.051795 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.052869 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.052869 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.052869 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.052869 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053146 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053226 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053355 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053514 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053672 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053829 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.053999 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054157 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054321 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054556 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054635 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054790 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.054941 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055104 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055269 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055435 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055586 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055756 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.055911 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056076 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056887 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056887 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056887 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056887 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.056887 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.057732 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.058483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.058483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.058483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.058483 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.059227 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.059395 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.059554 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.059711 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.059950 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.060154 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.061132 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 11:21:42.061132 dv-cinder-760199-12-iscsi neutron-server[94287]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 11:21:42.090574 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:53.657228 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb00ef57-b26c-4276-8c18-eda31463a117 None None] get_active_networks_info from dv-cinder-760199-12-iscsi {{(pid=94434) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Sep 03 11:21:53.742823 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb00ef57-b26c-4276-8c18-eda31463a117 None None] No non-hosted networks {{(pid=94434) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Sep 03 11:21:53.752818 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.agentschedulers_db [None req-eb00ef57-b26c-4276-8c18-eda31463a117 None None] DHCP Agent not found on host dv-cinder-760199-12-iscsi {{(pid=94434) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Sep 03 11:21:53.891310 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-f0f62587-35a2-48a6-b268-b5b134ce85fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:56.380704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3e2754a0-c018-46c8-92f4-1a7cf7ee9f86 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:56.414184 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.db.api [None req-7f503bb9-bd02-428c-bcea-b8f0709c9365 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-760199-12-iscsi {{(pid=94434) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 03 11:21:56.414995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG oslo_db.api [None req-7f503bb9-bd02-428c-bcea-b8f0709c9365 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 03 11:21:56.730715 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:56.731919 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.732290 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.732597 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.733202 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.733678 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.734194 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.734734 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.735314 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.735827 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.736325 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.736851 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.737364 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:21:56.737940 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-760199-12-iscsi', {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:56.752718 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-760199-12-iscsi', 'version_map': {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:21:57.003757 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7f503bb9-bd02-428c-bcea-b8f0709c9365 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:57.633513 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:21:59.001505 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:00.095589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57126) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:00.580846 dv-cinder-760199-12-iscsi neutron-server[94432]: WARNING oslo_policy.policy [None req-6bbd73ff-16df-4e88-906a-3725babe0ca7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:00.581415 dv-cinder-760199-12-iscsi neutron-server[94432]: WARNING oslo_policy.policy [None req-6bbd73ff-16df-4e88-906a-3725babe0ca7 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:00.802292 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [None req-6bbd73ff-16df-4e88-906a-3725babe0ca7 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:22:00.803329 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6bbd73ff-16df-4e88-906a-3725babe0ca7 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7068329 Sep 03 11:22:03.219146 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57140) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:03.547328 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.db.l3_hamode_db [None req-eab1fd21-b821-4f3c-8b1b-4f8c32acf365 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Sep 03 11:22:03.625900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eab1fd21-b821-4f3c-8b1b-4f8c32acf365 None None] Routers set() bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:22:03.626287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eab1fd21-b821-4f3c-8b1b-4f8c32acf365 None None] Router IDs set() for agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Sep 03 11:22:03.719205 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING oslo_policy.policy [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:03.719814 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING oslo_policy.policy [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:03.941403 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] Request body: {'subnetpool': {'shared': True, 'is_default': True, 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:04.035232 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.policy [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=94433) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 03 11:22:04.080888 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING oslo_policy.policy [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:04.081253 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING oslo_policy.policy [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:04.089813 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.quota [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] Loaded quota_driver: . Sep 03 11:22:04.271511 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713925427', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713924332', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713912414', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713910586', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713233503', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8726713955950', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-16440606', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16531622', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-873192', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-959774'] for rbac-policy, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:04.475930 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:04.477245 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3c353e98-a6ec-48f0-a6f6-ddff209b1caf admin admin] 10.222.0.16 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.2558889 Sep 03 11:22:07.083392 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57158) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:07.377868 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Request body: {'network': {'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'name': 'private', 'admin_state_up': True}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:07.479062 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Made reservation on behalf of 0e569c2ded6e45a2b67006cbdd8c4a22 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:22:07.482655 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.500159 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.618462 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.675528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.695044 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] vlan segment allocate from pool success with {'vlan_id': 390, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:22:07.722639 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8726710753868', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.723213 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Unsubscribe: segment precommit_create {{(pid=94433) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 03 11:22:07.723743 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Added segment 2049e60c-f3ca-43a7-93e9-39447ec33263 of type vlan for network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 Sep 03 11:22:07.739682 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f915b42-f56a-40ab-b149-f49b51363c4c,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:07.786001 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.786280 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.786641 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.786970 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.787293 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.787628 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.787951 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.788283 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.788618 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.788936 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.789249 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.789561 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Tracked resource versions report: Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: pushed versions: Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: { 'AddressGroup': {'1.2'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'ConntrackHelper': {'1.0'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Log': {'1.0'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Network': {'1.1'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Port': {'1.7'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'PortForwarding': {'1.2'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'QosPolicy': {'1.9'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroup': {'1.4'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SubPort': {'1.0'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Subnet': {'1.1'}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Trunk': {'1.1'}} Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: consumer versions: Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'ConntrackHelper': '1.0', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Log': '1.0', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Network': '1.1', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Port': '1.7', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'PortForwarding': '1.2', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'QosPolicy': '1.9', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroup': '1.4', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroupRule': '1.2', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SubPort': '1.0', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Subnet': '1.1', Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Trunk': '1.1'}} Sep 03 11:22:07.790969 dv-cinder-760199-12-iscsi neutron-server[94433]: {{(pid=94433) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:22:07.844465 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.944254 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:07.945476 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:07.946133 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:08.041921 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] Pushing event updated for resources: {'Network': ['ID=b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:08.052996 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:22:08.053552 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bce97c74-838c-431b-a6f8-4ef53228fd39 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.9690919 Sep 03 11:22:10.800343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57172) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:11.195020 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-421c0806-0a95-46c3-920f-c5a789bd3163 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:11.196389 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-421c0806-0a95-46c3-920f-c5a789bd3163 admin admin] 10.222.0.16 "GET /v2.0/networks/b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 HTTP/1.1" status: 200 len: 825 time: 0.3950827 Sep 03 11:22:11.222676 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-95f6d991-9ace-4939-8504-0929124028b8 admin admin] 10.222.0.16 "GET /v2.0/subnetpools/2fa38d57-abc6-46db-8467-07f0a4028ab4 HTTP/1.1" status: 200 len: 734 time: 0.0195551 Sep 03 11:22:11.231733 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Request body: {'subnet': {'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4', 'ip_version': 4, 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:11.326909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Made reservation on behalf of 0e569c2ded6e45a2b67006cbdd8c4a22 for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:22:11.329073 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:11.675884 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:11.743843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Checking segment: {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:22:11.744206 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Network hostable DHCP agents. Network: b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:22:11.751503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6bcf8be-f50d-415c-8a4b-75f19f9af7b3,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:11.841209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:22:11.921277 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:11.926255 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:11.926820 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:11.930897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-533c6229-7ed1-43d0-b8ea-105033352faf None None] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:22:12.011228 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c1b50465-280e-4ad2-90aa-bf67baf0af98 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7827721 Sep 03 11:22:12.257840 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:22:12.259184 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:12.536170 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Allocated IP 172.20.0.2 (b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3/9fd9c80c-e5be-4d8e-b128-7d93c26487ac) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:22:12.740279 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:12.783846 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Transition to ACTIVE for port object 9fd9c80c-e5be-4d8e-b128-7d93c26487ac will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:22:12.804968 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Transition to ACTIVE for port object 9fd9c80c-e5be-4d8e-b128-7d93c26487ac will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:22:12.876148 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:12.945963 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:22:12.952282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:12.955580 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:22:12.966531 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Pushing event updated for resources: {'Port': ['ID=9fd9c80c-e5be-4d8e-b128-7d93c26487ac,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:12.996888 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.997252 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.997597 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.997932 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.998261 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.998615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.998940 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.999263 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.999602 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:12.999957 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:13.000244 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:13.000561 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Tracked resource versions report: Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: pushed versions: Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: { 'AddressGroup': {'1.2'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'ConntrackHelper': {'1.0'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Log': {'1.0'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Network': {'1.1'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Port': {'1.7'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'PortForwarding': {'1.2'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'QosPolicy': {'1.9'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroup': {'1.4'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SubPort': {'1.0'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Subnet': {'1.1'}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Trunk': {'1.1'}} Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: consumer versions: Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'ConntrackHelper': '1.0', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Log': '1.0', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Network': '1.1', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Port': '1.7', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'PortForwarding': '1.2', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'QosPolicy': '1.9', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroup': '1.4', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroupRule': '1.2', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SubPort': '1.0', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Subnet': '1.1', Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Trunk': '1.1'}} Sep 03 11:22:13.001948 dv-cinder-760199-12-iscsi neutron-server[94434]: {{(pid=94434) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:22:13.049525 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Attempting to bind port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:22:13.049916 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Attempting to bind port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:22:13.050390 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Attempting to bind port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac on network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:22:13.055350 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 21, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:22:13.055701 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Checking segment: {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:22:13.056155 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:13.056542 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Bound using segment: {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:22:13.057002 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Bound port: 9fd9c80c-e5be-4d8e-b128-7d93c26487ac, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:22:13.057399 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:13.119466 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] For port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:22:13.124247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] For port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=9fd9c80c-e5be-4d8e-b128-7d93c26487ac,segment=NetworkSegment(2049e60c-f3ca-43a7-93e9-39447ec33263),segment_id=2049e60c-f3ca-43a7-93e9-39447ec33263)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:22:13.230174 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:13.299360 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b8968b-c7ae-46c9-85ec-a323f66c53a2 None None] Pushing event updated for resources: {'Port': ['ID=9fd9c80c-e5be-4d8e-b128-7d93c26487ac,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:14.471912 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57180) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:14.794715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [None req-3017e6f9-8495-47f0-bdac-79df284f3608 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:22:14.795615 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-3017e6f9-8495-47f0-bdac-79df284f3608 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3228652 Sep 03 11:22:17.226583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57188) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:17.538864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [None req-b4e0e4a9-5403-471d-b9e2-0ccc0c220831 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:22:17.541669 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b4e0e4a9-5403-471d-b9e2-0ccc0c220831 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3122971 Sep 03 11:22:20.212446 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57198) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:20.508074 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:20.571290 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.policy [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=94432) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 03 11:22:20.617122 dv-cinder-760199-12-iscsi neutron-server[94432]: WARNING oslo_policy.policy [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:20.617491 dv-cinder-760199-12-iscsi neutron-server[94432]: WARNING oslo_policy.policy [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 03 11:22:20.626536 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.quota [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Loaded quota_driver: . Sep 03 11:22:20.753676 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:20.755652 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:20.913010 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:20.988576 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:21.101515 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:21.102788 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-50d35b10-0f0c-4d67-a6e9-b28ba2537603 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.8893907 Sep 03 11:22:21.792686 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d742eee7-68aa-4e8f-9200-ae6e63ea124b None None] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:22:21.958595 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-6acb9440-759d-48a9-a0e3-0d0fd40118dd None None] Provisioning for port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:22:22.415515 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 9fd9c80c-e5be-4d8e-b128-7d93c26487ac up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:22.558602 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:22:22.563409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:22.563801 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:22.668206 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:22.701669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=9fd9c80c-e5be-4d8e-b128-7d93c26487ac,segment=NetworkSegment(2049e60c-f3ca-43a7-93e9-39447ec33263),segment_id=2049e60c-f3ca-43a7-93e9-39447ec33263)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:22:22.792933 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:22.840464 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=9fd9c80c-e5be-4d8e-b128-7d93c26487ac,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:23.509301 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57212) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:23.647131 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-57374686-4a21-4463-b090-7e9c29f500ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:23.817363 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [None req-9886a5eb-4879-47eb-bb71-aad366a180d4 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:22:23.818357 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9886a5eb-4879-47eb-bb71-aad366a180d4 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3081224 Sep 03 11:22:24.394558 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 9fd9c80c-e5be-4d8e-b128-7d93c26487ac up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:24.443701 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:24.444071 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.208559 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57220) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:26.286833 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-38726825-6acb-4d6b-9974-05222f7360e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.519687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'name': 'public', 'is_default': True, 'router:external': True, 'admin_state_up': True}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:26.627506 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Made reservation on behalf of 44466736753b46cbaf5864054ab8faad for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:22:26.630180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.646760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.696065 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.764096 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.835376 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.848863 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Reserving flat network on physical network physnet1 {{(pid=94432) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Sep 03 11:22:26.879347 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8726710753868', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:26.879847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Unsubscribe: segment precommit_create {{(pid=94432) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 03 11:22:26.880398 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Added segment 18788aa0-7c42-4414-898c-7e3c618cd0d7 of type flat for network e4dc006d-fb22-4cc5-ae28-c350442b2099 Sep 03 11:22:26.886200 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3baec275-7698-48eb-a1d7-30abae662e66,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:26.921592 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.921944 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.922286 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.922646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.922975 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.923315 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.923642 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.923980 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.924323 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.924645 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.924961 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.925278 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Tracked resource versions report: Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: pushed versions: Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: { 'AddressGroup': {'1.2'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'ConntrackHelper': {'1.0'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Log': {'1.0'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Network': {'1.1'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Port': {'1.7'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'PortForwarding': {'1.2'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'QosPolicy': {'1.9'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroup': {'1.4'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SubPort': {'1.0'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Subnet': {'1.1'}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Trunk': {'1.1'}} Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: consumer versions: Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'ConntrackHelper': '1.0', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Log': '1.0', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Network': '1.1', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Port': '1.7', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'PortForwarding': '1.2', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'QosPolicy': '1.9', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroup': '1.4', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroupRule': '1.2', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SubPort': '1.0', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Subnet': '1.1', Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Trunk': '1.1'}} Sep 03 11:22:26.926685 dv-cinder-760199-12-iscsi neutron-server[94432]: {{(pid=94432) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:22:27.009246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:27.130257 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:27.131377 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:27.132149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:27.229888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] Pushing event updated for resources: {'Network': ['ID=e4dc006d-fb22-4cc5-ae28-c350442b2099,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:27.239355 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-61115b28-0f9b-476f-a653-cacbdc45cf14 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 1.0297654 Sep 03 11:22:27.240279 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:22:27.547566 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:27.952499 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:22:28.949769 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:29.638906 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57242) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:29.811883 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27dd8f40-891f-4d84-87da-ac6a360db89c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:29.813205 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-27dd8f40-891f-4d84-87da-ac6a360db89c admin admin] 10.222.0.16 "GET /v2.0/subnets/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3 HTTP/1.1" status: 200 len: 849 time: 0.1733160 Sep 03 11:22:29.969793 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ac2e753c-5435-479b-aaf8-4f70ff4fe07c admin admin] 10.222.0.16 "GET /v2.0/routers/dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 HTTP/1.1" status: 200 len: 704 time: 0.1503844 Sep 03 11:22:30.233737 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:30.526941 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Allocated IP 172.20.0.1 (b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3/92f77dba-af67-4222-b650-54fbb8b228af) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:22:30.684597 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:30.706845 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Transition to ACTIVE for port object 92f77dba-af67-4222-b650-54fbb8b228af will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:22:30.827877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:30.896617 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:22:30.901237 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:30.968210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:22:30.968764 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:30.987692 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Pushing event updated for resources: {'Port': ['ID=92f77dba-af67-4222-b650-54fbb8b228af,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:31.141528 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-88e770f0-8d64-4327-947d-b6edad0c12c4 None None] Provisioning for port 92f77dba-af67-4222-b650-54fbb8b228af completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:22:31.145341 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-88e770f0-8d64-4327-947d-b6edad0c12c4 None None] Provisioning complete for port 92f77dba-af67-4222-b650-54fbb8b228af triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:31.145738 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-88e770f0-8d64-4327-947d-b6edad0c12c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.181442 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-88e770f0-8d64-4327-947d-b6edad0c12c4 None None] Port 92f77dba-af67-4222-b650-54fbb8b228af cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:22:31.218342 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.424085 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.486316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.487123 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.549280 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Pushing event updated for resources: {'Port': ['ID=92f77dba-af67-4222-b650-54fbb8b228af,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:31.610430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:22:31.611785 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:31.801736 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-08fd14c8-0520-42d9-9521-325b15031634 None None] Provisioning complete for port 92f77dba-af67-4222-b650-54fbb8b228af triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:31.802104 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-08fd14c8-0520-42d9-9521-325b15031634 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:31.830000 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94433) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:22:31.836766 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-08fd14c8-0520-42d9-9521-325b15031634 None None] Port 92f77dba-af67-4222-b650-54fbb8b228af cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:22:31.920210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:22:31.925852 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8a6d001a-1aa2-44ce-ae8c-80cd48db6a54 admin admin] 10.222.0.16 "PUT /v2.0/routers/dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9499872 Sep 03 11:22:31.930544 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Sync routers for ids ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:22:31.945086 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Routers {'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:22:31.945904 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:22:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:32.131283 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Set router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:22:32.555469 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:31Z', 'revision_number': 2, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port_host': None, '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:31Z', 'revision_number': 2, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:32.612266 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Checking router: dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:22:32.612634 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Updating router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 port 92f77dba-af67-4222-b650-54fbb8b228af binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:22:32.661544 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.172831 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.191807 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Transition to ACTIVE for port object 92f77dba-af67-4222-b650-54fbb8b228af will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:22:33.258332 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.423407 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Pushing event updated for resources: {'Port': ['ID=92f77dba-af67-4222-b650-54fbb8b228af,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:33.431258 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Attempting to bind port 92f77dba-af67-4222-b650-54fbb8b228af on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:22:33.431646 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Attempting to bind port 92f77dba-af67-4222-b650-54fbb8b228af by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:22:33.432094 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Attempting to bind port 92f77dba-af67-4222-b650-54fbb8b228af on network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:22:33.435218 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.435564 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.435902 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.436227 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.436555 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.436882 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.437207 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.437529 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.437867 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.438190 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.438536 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.438854 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Tracked resource versions report: Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: pushed versions: Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: { 'AddressGroup': {'1.2'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'ConntrackHelper': {'1.0'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Log': {'1.0'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Network': {'1.1'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Port': {'1.7'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'PortForwarding': {'1.2'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'QosPolicy': {'1.9'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroup': {'1.4'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SubPort': {'1.0'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Subnet': {'1.1'}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Trunk': {'1.1'}} Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: consumer versions: Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'ConntrackHelper': '1.0', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Log': '1.0', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Network': '1.1', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Port': '1.7', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'PortForwarding': '1.2', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'QosPolicy': '1.9', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroup': '1.4', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroupRule': '1.2', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SubPort': '1.0', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Subnet': '1.1', Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Trunk': '1.1'}} Sep 03 11:22:33.440250 dv-cinder-760199-12-iscsi neutron-server[94435]: {{(pid=94435) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:22:33.445809 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:22:33.446215 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Checking segment: {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:22:33.446701 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.447083 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Bound using segment: {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:22:33.447576 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Bound port: 92f77dba-af67-4222-b650-54fbb8b228af, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2049e60c-f3ca-43a7-93e9-39447ec33263', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:22:33.447969 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.514842 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] For port 92f77dba-af67-4222-b650-54fbb8b228af, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:22:33.533774 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] For port 92f77dba-af67-4222-b650-54fbb8b228af, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=92f77dba-af67-4222-b650-54fbb8b228af,segment=NetworkSegment(2049e60c-f3ca-43a7-93e9-39447ec33263),segment_id=2049e60c-f3ca-43a7-93e9-39447ec33263)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:22:33.624800 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:33.682244 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b51dc1d8-4da5-45d6-952b-8c8951aa9d18 None None] Pushing event updated for resources: {'Port': ['ID=92f77dba-af67-4222-b650-54fbb8b228af,revision_number=4']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:33.691855 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Routers {'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:22:33.692475 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:22:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:33.789128 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] Set router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:22:34.010213 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:31Z', 'revision_number': 2, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port_host': None, '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:33Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:34.037096 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13e9d01d-39b0-4497-bec5-7f39930d1908 None None] The sync data for ids ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'] in dv-cinder-760199-12-iscsi is: [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:31Z', 'revision_number': 2, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port_host': None, '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:33Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:22:34.201837 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57262) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:34.313779 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-787c5784-d4a7-4330-a4a4-01a6a8d174f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:34.315107 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-787c5784-d4a7-4330-a4a4-01a6a8d174f2 admin admin] 10.222.0.16 "GET /v2.0/networks/e4dc006d-fb22-4cc5-ae28-c350442b2099 HTTP/1.1" status: 200 len: 842 time: 0.1121485 Sep 03 11:22:34.325103 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Request body: {'subnet': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'cidr': '172.27.0.0/24', 'enable_dhcp': False, 'gateway_ip': '172.27.0.1', 'ip_version': 4, 'name': 'public-subnet'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:34.452389 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Made reservation on behalf of 44466736753b46cbaf5864054ab8faad for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:22:34.455155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:34.805604 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.objects.ports [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=94433) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Sep 03 11:22:34.806032 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:34.863208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Pushing event updated for resources: {'Subnet': ['ID=70f046b3-3044-4e5c-ab3d-346ae147680d,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:34.867297 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:22:34.867648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Network hostable DHCP agents. Network: e4dc006d-fb22-4cc5-ae28-c350442b2099, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:22:34.941210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:22:35.003955 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, e4dc006d-fb22-4cc5-ae28-c350442b2099) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:35.007864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:35.008447 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:35.015667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90f9ada4-0d86-495e-8dc8-0c49cb799d6c None None] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:22:35.113894 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3b44621f-0c47-44d8-af5d-656016d97371 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7803235 Sep 03 11:22:35.140340 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-474cb656-5423-4c29-920a-9eb8cc120836 None None] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:22:37.422714 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57270) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:37.561580 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-160f94c6-6b53-48b4-a030-197c1ec4eec2 admin admin] 10.222.0.16 "GET /v2.0/routers/dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 HTTP/1.1" status: 200 len: 710 time: 0.1376252 Sep 03 11:22:37.727895 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40a739eb-2f0d-4ae4-91fc-588cb6303d75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:22:37.735582 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-40a739eb-2f0d-4ae4-91fc-588cb6303d75 admin admin] 10.222.0.16 "GET /v2.0/networks/e4dc006d-fb22-4cc5-ae28-c350442b2099 HTTP/1.1" status: 200 len: 886 time: 0.1679797 Sep 03 11:22:37.739731 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:22:37.994658 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:38.280951 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:38.357512 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:38.517981 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Allocated IP 172.27.0.16 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/7b3828dd-5f74-4a48-9340-7f22480caa69) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:22:38.619716 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:38.732719 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:38.770346 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Pushing event updated for resources: {'Port': ['ID=7b3828dd-5f74-4a48-9340-7f22480caa69,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:38.784053 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:22:38.785343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:22:38.787570 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:22:39.085722 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:39.383851 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-783502', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-757054', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-11858'] for router, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:39.387608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-783495', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-783504', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-757047'] for router, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:39.495707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:22:39.599900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:22:39.604230 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:39.605289 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b5f1e1a4-4d32-485e-8061-0abdeda65eb4 admin admin] 10.222.0.16 "PUT /v2.0/routers/dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 HTTP/1.1" status: 200 len: 889 time: 1.8689580 Sep 03 11:22:40.431603 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 92f77dba-af67-4222-b650-54fbb8b228af up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:40.535519 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Sync routers for ids ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:22:40.545588 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Routers {'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:22:40.546233 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:22:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:40.603944 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 92f77dba-af67-4222-b650-54fbb8b228af completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:22:40.626687 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 92f77dba-af67-4222-b650-54fbb8b228af triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:40.627067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:40.853258 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Set router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:22:40.986308 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.132901 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 92f77dba-af67-4222-b650-54fbb8b228af, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=92f77dba-af67-4222-b650-54fbb8b228af,segment=NetworkSegment(2049e60c-f3ca-43a7-93e9-39447ec33263),segment_id=2049e60c-f3ca-43a7-93e9-39447ec33263)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:22:41.205539 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.294283 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=92f77dba-af67-4222-b650-54fbb8b228af,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:41.334569 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:38Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port': {'id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:38Z', 'updated_at': '2021-09-03T11:22:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:33Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:41.387335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Checking router: dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:22:41.387824 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Updating router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 port 7b3828dd-5f74-4a48-9340-7f22480caa69 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:22:41.435084 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.751754 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.761253 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Transition to ACTIVE for port object 7b3828dd-5f74-4a48-9340-7f22480caa69 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:22:41.890031 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.942817 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Attempting to bind port 7b3828dd-5f74-4a48-9340-7f22480caa69 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:22:41.943184 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Attempting to bind port 7b3828dd-5f74-4a48-9340-7f22480caa69 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:22:41.943542 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Attempting to bind port 7b3828dd-5f74-4a48-9340-7f22480caa69 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:22:41.946414 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87334a2a-ab52-4dde-8cba-aa38eba67d30 None None] Pushing event updated for resources: {'Port': ['ID=7b3828dd-5f74-4a48-9340-7f22480caa69,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:41.952120 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:22:41.952499 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:22:41.952869 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:41.953247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:22:41.954029 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Bound port: 7b3828dd-5f74-4a48-9340-7f22480caa69, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:22:41.954594 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:42.053091 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] For port 7b3828dd-5f74-4a48-9340-7f22480caa69, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:22:42.057363 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] For port 7b3828dd-5f74-4a48-9340-7f22480caa69, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7b3828dd-5f74-4a48-9340-7f22480caa69,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:22:42.061652 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57282) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:22:42.158963 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:42.183605 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e041c597-5a27-45c1-a894-63572701bfd4 admin admin] 10.222.0.16 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1208124 Sep 03 11:22:42.221035 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Routers {'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:22:42.221680 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:22:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:42.226995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87334a2a-ab52-4dde-8cba-aa38eba67d30 None None] Pushing event updated for resources: {'Port': ['ID=7b3828dd-5f74-4a48-9340-7f22480caa69,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:42.413670 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 92f77dba-af67-4222-b650-54fbb8b228af up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:42.453145 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] Set router dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:22:42.550842 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 92f77dba-af67-4222-b650-54fbb8b228af triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:42.551209 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:42.754517 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:38Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port': {'id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:38Z', 'updated_at': '2021-09-03T11:22:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:41Z', 'revision_number': 5, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:22:42.784189 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ac1477-8c71-454b-be2f-050baa8c142b None None] The sync data for ids ['dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5'] in dv-cinder-760199-12-iscsi is: [{'id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'name': 'router1', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16'}], 'enable_snat': True}, 'gw_port_id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:22:20Z', 'updated_at': '2021-09-03T11:22:38Z', 'revision_number': 4, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'gw_port': {'id': '7b3828dd-5f74-4a48-9340-7f22480caa69', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:2b:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.16', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:38Z', 'updated_at': '2021-09-03T11:22:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '92f77dba-af67-4222-b650-54fbb8b228af', 'name': '', 'network_id': 'b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377', 'tenant_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'mac_address': 'fa:16:3e:12:5a:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dec14bcc-9a51-4fd5-a4b1-8466b3feb1e5', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:22:30Z', 'updated_at': '2021-09-03T11:22:41Z', 'revision_number': 5, 'project_id': '0e569c2ded6e45a2b67006cbdd8c4a22', 'subnets': [{'id': 'd6bcf8be-f50d-415c-8a4b-75f19f9af7b3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2fa38d57-abc6-46db-8467-07f0a4028ab4'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:22:44.447441 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7b3828dd-5f74-4a48-9340-7f22480caa69 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:44.587192 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 7b3828dd-5f74-4a48-9340-7f22480caa69 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:22:44.591986 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 7b3828dd-5f74-4a48-9340-7f22480caa69 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:44.592368 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:44.686351 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:44.709251 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 7b3828dd-5f74-4a48-9340-7f22480caa69, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7b3828dd-5f74-4a48-9340-7f22480caa69,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:22:44.789615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:44.863512 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=7b3828dd-5f74-4a48-9340-7f22480caa69,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:22:46.456501 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7b3828dd-5f74-4a48-9340-7f22480caa69 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:22:46.539237 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 7b3828dd-5f74-4a48-9340-7f22480caa69 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:22:46.539864 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:53.638825 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cbb53379-8b97-4aa9-b147-c62b907190f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:56.286494 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-87754d49-37f4-40fb-823a-b21c2d5e3ed4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:56.692264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:57.581971 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:22:58.958438 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:04.951250 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:23:23.644077 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-748c39e1-b977-4732-87be-da02a3545cc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:26.306353 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-af783afa-bc63-4019-8f02-2ea887772b79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:26.684238 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:27.627652 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:29.643874 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:41.951726 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:23:53.644833 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-eaab01f6-e572-4848-89a9-29c47cd606ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:56.290541 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a98e8426-085d-4e71-bc68-d301b1d21e33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:56.668203 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:57.579431 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:23:59.011457 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:18.950591 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:24:21.188421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57844) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:21.258707 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.pecan_wsgi.hooks.translation [None req-8d512c0d-2552-4e0d-8702-c8a50bec706c admin admin] GET failed (client error): The resource could not be found. Sep 03 11:24:21.260014 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8d512c0d-2552-4e0d-8702-c8a50bec706c admin admin] 10.222.0.16 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0706460 Sep 03 11:24:21.444969 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7672f2a7-eab9-4392-84e3-472cd9258d84 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:21.446498 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-7672f2a7-eab9-4392-84e3-472cd9258d84 admin admin] 10.222.0.16 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1812289 Sep 03 11:24:23.637218 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d2cf1593-f6b2-4d1a-976f-30a6aaf7d59e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:23.644239 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57854) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:23.780362 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-041c3d23-1902-4a59-a54e-ea3ab044321b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:23.781725 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-041c3d23-1902-4a59-a54e-ea3ab044321b admin admin] 10.222.0.16 "GET /v2.0/subnets/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3 HTTP/1.1" status: 200 len: 849 time: 0.1365101 Sep 03 11:24:23.791662 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:24:23.877065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Notify callbacks [] for subnet, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:24.077239 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8726710630593'] for subnet, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:24.112703 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:24.113334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:24.115139 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] 10.222.0.16 "PUT /v2.0/subnets/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3 HTTP/1.1" status: 200 len: 868 time: 0.3267691 Sep 03 11:24:24.133454 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bfac8dc-c9e3-4e12-9b70-30acac1d5698 None None] Network b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:24:24.142022 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6bcf8be-f50d-415c-8a4b-75f19f9af7b3,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:24:24.152519 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.153049 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.153548 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.154041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.154562 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.155066 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.155562 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.156650 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.156650 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.157083 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.157562 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.158339 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a1386b-8e90-4eee-9392-027c34d5cd0c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:24:24.515674 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d5d096c9-bebe-4056-8bbe-5bb60e1c90c6 None None] Provisioning complete for port 92f77dba-af67-4222-b650-54fbb8b228af triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:24:24.516034 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d5d096c9-bebe-4056-8bbe-5bb60e1c90c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:24.602280 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d5d096c9-bebe-4056-8bbe-5bb60e1c90c6 None None] Provisioning complete for port 9fd9c80c-e5be-4d8e-b128-7d93c26487ac triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:24:24.602605 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d5d096c9-bebe-4056-8bbe-5bb60e1c90c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:26.290364 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-dbfb07a4-1837-4c0d-9b1f-83c3453a7149 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:26.324802 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57862) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:26.524785 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-662518b3-e403-472b-835a-92c2359560e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:26.525196 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-662518b3-e403-472b-835a-92c2359560e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:26.526907 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-662518b3-e403-472b-835a-92c2359560e5 admin admin] 10.222.0.16 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2011440 Sep 03 11:24:26.661415 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:27.568264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:28.756268 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 57870) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:28.889989 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-441e57d6-3364-45ac-a4da-23e4c7ea00b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:28.890848 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-441e57d6-3364-45ac-a4da-23e4c7ea00b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:28.894479 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-441e57d6-3364-45ac-a4da-23e4c7ea00b6 admin admin] 10.222.0.16 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1348701 Sep 03 11:24:28.968826 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:31.097585 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57878) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:31.232188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fd87572-f169-41ee-9215-9593066e72a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:31.233582 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2fd87572-f169-41ee-9215-9593066e72a9 admin admin] 10.222.0.16 "GET /v2.0/networks/b4c1d9bf-b6f3-452c-ac5c-6a4d1e141377 HTTP/1.1" status: 200 len: 869 time: 0.1350386 Sep 03 11:24:33.453785 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57888) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:33.580239 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14d80089-6765-4454-ba5e-9db2f487ae33 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:33.581596 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-14d80089-6765-4454-ba5e-9db2f487ae33 admin admin] 10.222.0.16 "GET /v2.0/networks/e4dc006d-fb22-4cc5-ae28-c350442b2099 HTTP/1.1" status: 200 len: 886 time: 0.1269376 Sep 03 11:24:35.792166 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57896) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:35.913734 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ed83ef1-95a5-4e30-947b-247b059d372e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:35.914205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ed83ef1-95a5-4e30-947b-247b059d372e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:35.915752 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2ed83ef1-95a5-4e30-947b-247b059d372e admin admin] 10.222.0.16 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1225464 Sep 03 11:24:38.115977 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57904) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:38.213561 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f8d4666-89dc-4eb3-84ca-34c4a169d7ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:38.214208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f8d4666-89dc-4eb3-84ca-34c4a169d7ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:38.218965 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1f8d4666-89dc-4eb3-84ca-34c4a169d7ac admin admin] 10.222.0.16 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1018720 Sep 03 11:24:40.404227 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57912) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:40.488901 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80c81dec-a175-4f72-8105-52d8fc8c7bea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:40.490154 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-80c81dec-a175-4f72-8105-52d8fc8c7bea admin admin] 10.222.0.16 "GET /v2.0/subnets/70f046b3-3044-4e5c-ab3d-346ae147680d HTTP/1.1" status: 200 len: 816 time: 0.0849771 Sep 03 11:24:42.658948 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57920) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:24:42.755158 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db5f94a9-7245-4f6f-80bb-2f48018fce48 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:24:42.756485 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-db5f94a9-7245-4f6f-80bb-2f48018fce48 admin admin] 10.222.0.16 "GET /v2.0/subnets/d6bcf8be-f50d-415c-8a4b-75f19f9af7b3 HTTP/1.1" status: 200 len: 868 time: 0.0965865 Sep 03 11:24:53.621220 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-51fcc7fa-504e-4014-889f-b591835ae2c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:55.948677 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:24:56.288976 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ba28f939-dac3-44a9-a130-76bbf64d4d1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:56.693166 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:57.563473 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:24:58.969139 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:07.154159 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57974) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:25:07.205781 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [None req-4fea4f53-0276-4d09-9b42-90826c8430e8 admin admin] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:25:07.206822 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-4fea4f53-0276-4d09-9b42-90826c8430e8 admin admin] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0516734 Sep 03 11:25:09.508534 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57982) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:25:09.569022 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a83461e-1fb5-482f-a33f-c42bc3154ab2 admin admin] GET failed (client error): The resource could not be found. Sep 03 11:25:09.570324 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1a83461e-1fb5-482f-a33f-c42bc3154ab2 admin admin] 10.222.0.16 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0603325 Sep 03 11:25:09.713463 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88f06d03-17f0-4f09-9691-d053fbd1d325 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:25:09.714975 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-88f06d03-17f0-4f09-9691-d053fbd1d325 admin admin] 10.222.0.16 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1393485 Sep 03 11:25:12.124129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57990) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:25:12.174047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:25:12.321876 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Made reservation on behalf of 44466736753b46cbaf5864054ab8faad for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:25:12.324160 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:12.353491 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING neutron.services.revisions.revision_plugin [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Could not find related network for resource to bump revision. Sep 03 11:25:12.365630 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] vlan segment allocate from pool success with {'vlan_id': 369, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:25:12.374608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:12.374942 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Added segment 6ed52ab9-b39d-44c8-aab2-33332f5ea8fb of type vlan for network aca5ae01-5c6f-4607-8a45-d689affa9a6c Sep 03 11:25:12.421993 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:12.523322 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:12.524310 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:25:12.525199 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:12.585750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Pushing event updated for resources: {'Network': ['ID=aca5ae01-5c6f-4607-8a45-d689affa9a6c,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:25:12.593342 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.593690 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.594026 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.594359 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.594715 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.595061 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.595393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.595735 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.596162 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.596485 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.596805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.597122 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:12.608171 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:25:12.609871 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-7308a37e-9cce-4db9-8f8a-288fbfa299b2 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4846315 Sep 03 11:25:14.857273 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 57998) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:25:14.922784 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf335980-89cd-4c0c-b794-a875993857bd admin admin] GET failed (client error): The resource could not be found. Sep 03 11:25:14.924123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-cf335980-89cd-4c0c-b794-a875993857bd admin admin] 10.222.0.16 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0658967 Sep 03 11:25:14.995703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff9ae9e0-c18f-43c5-a373-0642141fd695 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:25:14.997197 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ff9ae9e0-c18f-43c5-a373-0642141fd695 admin admin] 10.222.0.16 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0684280 Sep 03 11:25:15.007647 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:25:15.094156 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Made reservation on behalf of 44466736753b46cbaf5864054ab8faad for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:25:15.096281 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Notify callbacks [] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:15.316314 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:15.372224 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=900851b5-cacf-47af-aee5-848c49e99979,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:25:15.380644 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Checking segment: {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:25:15.380997 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Network hostable DHCP agents. Network: aca5ae01-5c6f-4607-8a45-d689affa9a6c, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:25:15.459843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:25:15.567420 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, aca5ae01-5c6f-4607-8a45-d689affa9a6c) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:25:15.571389 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:25:15.572003 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:15.578110 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06883f3b-f37b-4474-bb00-1a2dbf9fecd2 None None] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:25:15.642424 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1b112806-54d1-4f04-8fef-f3544c0138fc admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6380787 Sep 03 11:25:15.728766 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-aca5ae01-5c6f-4607-8a45-d689affa9a6c', 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c', 'tenant_id': '44466736753b46cbaf5864054ab8faad', 'fixed_ips': [{'subnet_id': '900851b5-cacf-47af-aee5-848c49e99979'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:25:15.729683 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:15.965965 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Allocated IP 192.168.233.2 (aca5ae01-5c6f-4607-8a45-d689affa9a6c/900851b5-cacf-47af-aee5-848c49e99979/f8370562-a6c4-4db4-a1a1-790028666f14) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:25:16.113035 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:16.121622 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Transition to ACTIVE for port object f8370562-a6c4-4db4-a1a1-790028666f14 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:25:16.136581 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Transition to ACTIVE for port object f8370562-a6c4-4db4-a1a1-790028666f14 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:25:16.202803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:16.252409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Pushing event updated for resources: {'Port': ['ID=f8370562-a6c4-4db4-a1a1-790028666f14,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:25:16.256118 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:25:16.260926 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:25:16.264133 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.264513 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.264865 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.265207 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.265564 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.265902 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.266233 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.266686 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.267039 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.267368 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.267698 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.268021 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:25:16.283598 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:25:16.350305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Attempting to bind port f8370562-a6c4-4db4-a1a1-790028666f14 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:25:16.350704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Attempting to bind port f8370562-a6c4-4db4-a1a1-790028666f14 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:25:16.351052 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Attempting to bind port f8370562-a6c4-4db4-a1a1-790028666f14 on network aca5ae01-5c6f-4607-8a45-d689affa9a6c {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:25:16.356786 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:25:16.357148 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Checking segment: {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:25:16.357539 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:16.357927 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Bound using segment: {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:25:16.358480 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Bound port: f8370562-a6c4-4db4-a1a1-790028666f14, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:25:16.358794 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:16.421329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] For port f8370562-a6c4-4db4-a1a1-790028666f14, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:25:16.424382 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] For port f8370562-a6c4-4db4-a1a1-790028666f14, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=f8370562-a6c4-4db4-a1a1-790028666f14,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:25:16.495944 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:16.552049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ff65fc-98e8-4d6c-a445-42e6bc8e6f10 None None] Pushing event updated for resources: {'Port': ['ID=f8370562-a6c4-4db4-a1a1-790028666f14,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:25:17.425517 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e7aca8f-5796-4189-9503-1dc5b1d84de4 None None] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:25:17.575049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-8d61f305-014f-4af0-896a-3b8b2ef465a9 None None] Provisioning for port f8370562-a6c4-4db4-a1a1-790028666f14 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:25:18.546258 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device f8370562-a6c4-4db4-a1a1-790028666f14 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:25:18.677716 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port f8370562-a6c4-4db4-a1a1-790028666f14 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:25:18.682784 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port f8370562-a6c4-4db4-a1a1-790028666f14 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:25:18.683151 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:18.761257 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:18.793257 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port f8370562-a6c4-4db4-a1a1-790028666f14, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=f8370562-a6c4-4db4-a1a1-790028666f14,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:25:18.860584 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:18.907655 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=f8370562-a6c4-4db4-a1a1-790028666f14,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:25:20.527533 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device f8370562-a6c4-4db4-a1a1-790028666f14 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:25:20.579589 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port f8370562-a6c4-4db4-a1a1-790028666f14 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:25:20.579956 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:23.637177 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3e0e0cc7-f9b4-4acf-a96f-f20f3cd13e5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:26.334196 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-33152ea9-ef4b-41e1-9a39-eccf537672e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:26.677029 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:27.596010 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:28.985653 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:32.948681 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:25:53.631105 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c5ce3b0e-4720-4265-9598-35aaa716b64f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:56.298129 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4fa49e97-d799-437c-882f-ad6378938c48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:56.676268 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:57.584897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:25:58.972574 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:09.946641 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:26:23.636043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1bdae683-e83a-466d-bc22-e299b05086ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:26.298915 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-dae90df0-6989-447c-82c6-e2fb65accc1a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:26.674603 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:27.572975 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:28.983737 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:39.705097 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58052) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:26:39.711494 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [None req-3e8758a3-4dbe-4850-897f-051958c7aba8 tempest-verify_tempest_config-1368706830 tempest-verify_tempest_config-1368706830-project] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:26:39.712469 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-3e8758a3-4dbe-4850-897f-051958c7aba8 tempest-verify_tempest_config-1368706830 tempest-verify_tempest_config-1368706830-project] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0064692 Sep 03 11:26:40.230585 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58070) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:26:40.330871 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.415585 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.486832 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.530280 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56fa8f49-8e04-4792-ac9b-8b78bd882879,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:26:40.534804 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=870dd31d02054aaeafaddc867793279d&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3032479 Sep 03 11:26:40.539403 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58074) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:26:40.539940 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.540306 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.540656 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.540991 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.541319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.541694 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.542023 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.542360 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.542767 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.543039 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.543356 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.543673 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c94c2-1556-4e2f-a98b-4ba502001b7d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.592909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.613386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.761129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.763740 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:40.764882 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/56fa8f49-8e04-4792-ac9b-8b78bd882879 HTTP/1.1" status: 204 len: 168 time: 0.2256532 Sep 03 11:26:40.773233 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56fa8f49-8e04-4792-ac9b-8b78bd882879,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:26:40.779798 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.780167 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.780508 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.780838 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.781166 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.781509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.781843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.782180 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.782549 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.782877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.783192 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:40.783510 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1bc6c6a5-fd3f-4e0c-a82e-88c210947eb0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:26:46.946295 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:26:53.641018 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-19f9d35d-19a0-4053-9a0c-1734559696ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:56.406518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-aea95c7d-da54-44ce-ba47-6455211464fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:56.698070 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:57.578082 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:26:58.983729 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:23.663070 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-736578d7-c387-4968-a29f-44501b9e030e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:23.944821 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:27:26.308836 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6b643d6d-04e9-430a-a0ee-794948897582 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:26.691299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:27.594948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:28.988523 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:53.662086 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-93aefc08-4bfe-4bbd-8006-cdf68ea55fab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:56.285006 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-26dc9d22-af4d-44a4-9232-e072ffbc0b8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:56.685098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:57.634127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:27:58.999249 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:00.943236 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 5 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:28:11.256037 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-769415'] for agent, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:23.672994 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6e560de7-34ef-44f6-9f8e-aa957674f786 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:26.097410 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58148) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:28:26.201540 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bc00e4c4-6a3a-4565-bd8e-3fc506a8b700 admin admin] 10.222.0.16 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.1030419 Sep 03 11:28:26.301712 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6e1e229a-fc6c-4694-a413-c560291c9405 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:26.701617 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:27.581979 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:28.432198 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58158) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:28:28.485542 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f3f9d893-011a-4525-a8f7-c121e634daae admin admin] 10.222.0.16 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4309 time: 0.0522795 Sep 03 11:28:28.998642 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:37.942576 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:28:41.209529 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:53.671921 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ac17349e-e0af-480b-8c1e-25e6c6622adc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:56.300652 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c3bdb6da-6fa2-4e7f-8c19-e2553488e9b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:56.666434 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:57.609392 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:28:58.986767 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:11.197672 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:14.941766 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:29:23.660562 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e2a63dce-72d7-4a49-9db9-d606d79eb755 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:26.299957 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95687ed5-af57-4ca7-8a3f-b989dee53fc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:26.688890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:27.597492 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:29.002745 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:41.209183 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:51.941106 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:29:53.671466 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e97405e2-8f3e-44e8-a0cf-681b2f6edf86 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:55.964286 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58312) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:56.317676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ba3010a-8777-4207-bc32-768390d90684 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:56.494615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1245852711-network', 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:56.665620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:56.668414 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:56.683769 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:56.694242 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:56.892076 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:56.979828 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.003569 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] vlan segment allocate from pool success with {'vlan_id': 355, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:29:57.012432 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b24b301c-ded5-47af-add6-32d0731d8740,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:57.021274 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.021625 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.021965 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.022288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.022635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.022973 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.023296 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.023628 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.023954 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.024266 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.024578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.024888 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Tracked resource versions report: Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: pushed versions: Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: { 'AddressGroup': {'1.2'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'ConntrackHelper': {'1.0'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Log': {'1.0'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Network': {'1.1'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Port': {'1.7'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'PortForwarding': {'1.2'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'QosPolicy': {'1.9'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroup': {'1.4'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SubPort': {'1.0'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Subnet': {'1.1'}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Trunk': {'1.1'}} Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: consumer versions: Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: HyperV agent@hv-cinder-76019: {}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'ConntrackHelper': '1.0', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Log': '1.0', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Network': '1.1', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Port': '1.7', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'PortForwarding': '1.2', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'QosPolicy': '1.9', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroup': '1.4', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SecurityGroupRule': '1.2', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'SubPort': '1.0', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Subnet': '1.1', Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: 'Trunk': '1.1'}} Sep 03 11:29:57.025994 dv-cinder-760199-12-iscsi neutron-server[94433]: {{(pid=94433) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:29:57.028900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.029226 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Added segment a77ae87c-5482-4ebb-ba25-dda037bc3bbb of type vlan for network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 Sep 03 11:29:57.069099 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.139905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.141081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:57.141704 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.210472 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] Pushing event updated for resources: {'Network': ['ID=778c15f4-3719-4d66-9e6d-1be38ac5cc42,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:57.221770 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-0dda532e-f1d9-4e58-9f43-36d19f8d47e3 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.2557888 Sep 03 11:29:57.222092 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:29:57.225427 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58372) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:57.231173 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Request body: {'subnet': {'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1245852711-subnet', 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:57.305265 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:57.307654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.549571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58384) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:57.597001 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.614431 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.671411 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c64b6662-4e29-47d5-96b7-4719ce1edb33,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:57.682090 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.682489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.682847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.683183 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.683520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.683888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.684226 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.684573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.684928 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.685253 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.685577 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.685898 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Tracked resource versions report: Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: pushed versions: Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: { 'AddressGroup': {'1.2'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'ConntrackHelper': {'1.0'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Log': {'1.0'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Network': {'1.1'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Port': {'1.7'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'PortForwarding': {'1.2'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'QosPolicy': {'1.9'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroup': {'1.4'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SubPort': {'1.0'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Subnet': {'1.1'}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Trunk': {'1.1'}} Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: consumer versions: Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: HyperV agent@hv-cinder-76019: {}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'ConntrackHelper': '1.0', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Log': '1.0', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Network': '1.1', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Port': '1.7', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'PortForwarding': '1.2', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'QosPolicy': '1.9', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroup': '1.4', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SecurityGroupRule': '1.2', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'SubPort': '1.0', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Subnet': '1.1', Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: 'Trunk': '1.1'}} Sep 03 11:29:57.687078 dv-cinder-760199-12-iscsi neutron-server[94432]: {{(pid=94432) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:29:57.699403 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Checking segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:29:57.699800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Network hostable DHCP agents. Network: 778c15f4-3719-4d66-9e6d-1be38ac5cc42, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:29:57.742631 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58396) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:57.797044 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:29:57.869184 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1865164337-network', 'tenant_id': '74f263fc57094cad9ed742802a83bff8'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:57.871151 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 778c15f4-3719-4d66-9e6d-1be38ac5cc42) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:29:57.881453 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b00203d5-9848-4053-9eb3-6eb4e371a03a None None] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:29:57.887091 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:57.889548 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.892005 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58408) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:57.916230 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2121533761-network', 'tenant_id': '236b2bd6994a4cb68504a40e24177949'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:57.939975 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Made reservation on behalf of 74f263fc57094cad9ed742802a83bff8 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:57.943149 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.952271 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:57.992227 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ffe76fa4-3203-4dbc-97cb-26e1d88eb876 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.7654755 Sep 03 11:29:58.017097 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.db.api [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 03 11:29:58.017097 dv-cinder-760199-12-iscsi neutron-server[94433]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Sep 03 11:29:58.017097 dv-cinder-760199-12-iscsi neutron-server[94433]: [parameters: {'project_id_1': '74f263fc57094cad9ed742802a83bff8', 'expiration_1': datetime.datetime(2021, 9, 3, 11, 29, 37, 963976)}] Sep 03 11:29:58.017097 dv-cinder-760199-12-iscsi neutron-server[94433]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=94433) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 03 11:29:58.018590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG oslo_db.api [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 03 11:29:58.056365 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44c2b744-50fa-4bf6-a68b-7d902f2723f9 None None] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:29:58.076822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Made reservation on behalf of 236b2bd6994a4cb68504a40e24177949 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:58.079255 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.088760 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.203418 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.224429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-63040892-network', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:58.273633 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.298260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] vlan segment allocate from pool success with {'vlan_id': 399, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:29:58.318942 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.324955 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Added segment 57454036-7c4c-4b28-af2a-cec867b4f781 of type vlan for network 5c249912-7262-498f-be3f-ef51c0e36269 Sep 03 11:29:58.331354 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=daae43c2-d4cd-4f35-9fdb-ae4acee4769e,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:58.369353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.396898 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Made reservation on behalf of 8e0bcf21f2dd49fe9f29d6892da5d5cc for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:58.399190 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.407334 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.499472 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.516288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:58.516288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.516288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.522571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.580000 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] Pushing event updated for resources: {'Network': ['ID=5c249912-7262-498f-be3f-ef51c0e36269,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:58.585028 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 5c249912-7262-498f-be3f-ef51c0e36269 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:29:58.598589 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.632648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:29:58.666822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1838712-6d05-446c-b11b-0c22b2ff679e,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:58.680383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.680736 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Added segment 177d43b1-95c4-4139-b1c2-29cb385a65be of type vlan for network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce Sep 03 11:29:58.689423 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-9fb2b424-b38c-414b-9ca1-1f5c24db0b47 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.9427614 Sep 03 11:29:58.689885 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58440) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:58.696290 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Request body: {'subnet': {'network_id': '5c249912-7262-498f-be3f-ef51c0e36269', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2121533761-subnet', 'tenant_id': '236b2bd6994a4cb68504a40e24177949', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:58.779538 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.853973 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.905739 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.908502 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:58.914976 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:58.981413 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] Pushing event updated for resources: {'Network': ['ID=246bd34f-94aa-4eae-85ba-a0f3e2f663ce,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:58.994174 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:29:58.994687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.045349 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1d1fa78-60d5-419f-8d28-eedee2876319,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:59.063139 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:29:59.075900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.076562 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Added segment 8483a2f2-1768-46a2-b6ca-7df7e3ec18b3 of type vlan for network e4ae560a-b704-4763-8338-c0b652784a4f Sep 03 11:29:59.085900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.124507 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1f744bd4-ea3d-4fe2-ad72-06b4ae6f744a admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.2285328 Sep 03 11:29:59.125714 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58464) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:59.135325 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Request body: {'subnet': {'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-63040892-subnet', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:59.140964 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.204180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Made reservation on behalf of 236b2bd6994a4cb68504a40e24177949 for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:59.206474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Notify callbacks [] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.266080 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.268514 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:59.269410 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.349741 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] Pushing event updated for resources: {'Network': ['ID=e4ae560a-b704-4763-8338-c0b652784a4f,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:59.360302 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Made reservation on behalf of 8e0bcf21f2dd49fe9f29d6892da5d5cc for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:59.361995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network e4ae560a-b704-4763-8338-c0b652784a4f details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:29:59.362800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.469233 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-07ea8d6f-78ec-4867-a07f-eba100909e28 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.9180119 Sep 03 11:29:59.469789 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58474) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:29:59.475347 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Request body: {'subnet': {'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1865164337-subnet', 'tenant_id': '74f263fc57094cad9ed742802a83bff8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:29:59.583361 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.649868 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Pushing event updated for resources: {'Subnet': ['ID=1cb35d32-0e24-4aa5-97d4-f4c21d6cf8f7,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:59.657583 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Checking segment: {'id': '57454036-7c4c-4b28-af2a-cec867b4f781', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': '5c249912-7262-498f-be3f-ef51c0e36269'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:29:59.658034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Network hostable DHCP agents. Network: 5c249912-7262-498f-be3f-ef51c0e36269, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:29:59.710858 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Made reservation on behalf of 74f263fc57094cad9ed742802a83bff8 for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:29:59.713178 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.768273 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.813821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Network 5c249912-7262-498f-be3f-ef51c0e36269 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:29:59.827518 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:29:59.862609 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Checking segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:29:59.864498 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Network hostable DHCP agents. Network: 246bd34f-94aa-4eae-85ba-a0f3e2f663ce, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:29:59.889469 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 5c249912-7262-498f-be3f-ef51c0e36269) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:29:59.894283 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:59.896768 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.900368 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c550c2e-ff17-4c86-aae4-aab1a42ed398 None None] Network 5c249912-7262-498f-be3f-ef51c0e36269 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:29:59.951308 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:29:59.969123 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 246bd34f-94aa-4eae-85ba-a0f3e2f663ce) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:29:59.975336 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:29:59.976071 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:29:59.979665 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53bbd43b-4af3-4ba0-8a56-f8d880424676 None None] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:00.003608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.014557 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e6f400ef-3e8e-4b92-83f5-98596a2441ba admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.3234513 Sep 03 11:30:00.078343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6c707ad6-c2c1-4d5a-a165-571e0df41796,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:00.095424 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-2e9185ff-6be6-46fb-b7ea-66d6545bf623 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.9684391 Sep 03 11:30:00.099050 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58494) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:00.100609 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Checking segment: {'id': '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:00.101012 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Network hostable DHCP agents. Network: e4ae560a-b704-4763-8338-c0b652784a4f, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:30:00.105812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:00.122159 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b4b0834-678d-4104-9f52-2c22bd5e0464 None None] Network 5c249912-7262-498f-be3f-ef51c0e36269 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:00.220252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Network e4ae560a-b704-4763-8338-c0b652784a4f is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:30:00.235701 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.237977 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.293026 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:30:00.294348 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.316811 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, e4ae560a-b704-4763-8338-c0b652784a4f) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:00.332909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:00.332909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.396910 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.438094 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5a553861-db9d-4e0a-a025-4ec09f2f9738 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.9672003 Sep 03 11:30:00.444694 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58526) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:00.450259 dv-cinder-760199-12-iscsi neutron-server[94433]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 03 11:30:00.454407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46ae350d-6c29-4ac2-9a13-940e241ef31a None None] Network e4ae560a-b704-4763-8338-c0b652784a4f requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:00.675143 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Allocated IP 172.20.0.2 (246bd34f-94aa-4eae-85ba-a0f3e2f663ce/d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a/7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:00.776864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-82b2a0fe-da92-4581-94fe-fffd7e0c0879 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:00.778553 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-82b2a0fe-da92-4581-94fe-fffd7e0c0879 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.3302522 Sep 03 11:30:00.796307 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:00.800419 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-6dd5100c-8bdf-4d03-a620-e962382bf450 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/quotas/7b665fdb80b4480ca82ebd31568efb7c HTTP/1.1" status: 200 len: 375 time: 0.0133252 Sep 03 11:30:00.847124 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd7ce19c-cf20-46c8-82bc-4f5ba0f84cdb None None] Network e4ae560a-b704-4763-8338-c0b652784a4f requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:00.870804 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-39953637-cd87-46f8-9652-8debe306f4c3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0633667 Sep 03 11:30:01.011347 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.042046 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Transition to ACTIVE for port object 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:01.103407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Transition to ACTIVE for port object 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:01.118267 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-954c64ff-4c7c-4256-b2d5-124694b7976e service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:30:01.120020 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-954c64ff-4c7c-4256-b2d5-124694b7976e service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0908129 Sep 03 11:30:01.227221 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.264918 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-5ac3ce69-4ac1-4455-a745-993dcea42c2f service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1382918 Sep 03 11:30:01.290468 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.311580 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Pushing event updated for resources: {'Port': ['ID=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:01.320037 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.326616 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.327228 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.327573 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.327899 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.328326 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.328651 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.328980 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.329354 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.329692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.330016 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.330407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.330767 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Tracked resource versions report: Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: pushed versions: Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: { 'AddressGroup': {'1.2'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'ConntrackHelper': {'1.0'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Log': {'1.0'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Network': {'1.1'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Port': {'1.7'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'PortForwarding': {'1.2'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'QosPolicy': {'1.9'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroup': {'1.4'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SubPort': {'1.0'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Subnet': {'1.1'}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Trunk': {'1.1'}} Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: consumer versions: Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: HyperV agent@hv-cinder-76019: {}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'ConntrackHelper': '1.0', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Log': '1.0', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Network': '1.1', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Port': '1.7', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'PortForwarding': '1.2', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'QosPolicy': '1.9', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroup': '1.4', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SecurityGroupRule': '1.2', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'SubPort': '1.0', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Subnet': '1.1', Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: 'Trunk': '1.1'}} Sep 03 11:30:01.333136 dv-cinder-760199-12-iscsi neutron-server[94434]: {{(pid=94434) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:30:01.338194 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:01.340053 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:01.344788 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:01.379160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58578) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:01.423860 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1007877178-network', 'tenant_id': 'afc73a33624b458192763aa6c8fee813'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:01.424779 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-3af5a9d8-d857-415d-9820-05cbe94ceb11 service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1512656 Sep 03 11:30:01.453374 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Attempting to bind port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:01.453948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Attempting to bind port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:01.454582 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Attempting to bind port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:01.462671 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 29, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:01.463307 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Checking segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:01.463894 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.464462 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Bound using segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:01.465858 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Bound port: 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:01.468004 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.517339 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58594) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:01.558213 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Allocated IP 172.27.0.234 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/5560cb35-25cc-4f08-87c3-68abb05c40aa) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:01.567163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Made reservation on behalf of afc73a33624b458192763aa6c8fee813 for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:01.571682 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.573156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] For port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:01.577945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] For port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:01.592697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.638060 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-54902c33-fe9f-4902-a979-990d4369c2b0 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:01.639832 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-54902c33-fe9f-4902-a979-990d4369c2b0 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/networks?id=e4ae560a-b704-4763-8338-c0b652784a4f HTTP/1.1" status: 200 len: 812 time: 0.1220198 Sep 03 11:30:01.655580 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-f39c303b-782d-4783-83fc-5056affc0c9d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/quotas/74f263fc57094cad9ed742802a83bff8 HTTP/1.1" status: 200 len: 375 time: 0.0092196 Sep 03 11:30:01.666052 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.718311 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-cbfcaa2f-bf26-4bd4-9fbc-5479a8f5f207 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=74f263fc57094cad9ed742802a83bff8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0559878 Sep 03 11:30:01.747058 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.749149 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42077ea-7a7a-4eec-9dff-9d8b2109e20a None None] Pushing event updated for resources: {'Port': ['ID=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:01.937559 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:01.976035 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-25ccd725-e19c-4047-b8af-c3321fd1f597 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:30:01.980759 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-25ccd725-e19c-4047-b8af-c3321fd1f597 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0826128 Sep 03 11:30:02.008438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.076474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] vlan segment allocate from pool success with {'vlan_id': 381, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:30:02.096895 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b5701f6-96b7-49aa-a0d7-bbd0c180d478,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:02.104312 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.107772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.108306 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Added segment e8eadc99-db36-4814-9810-1bea968f621c of type vlan for network 1e3d2aba-5ac3-475b-872e-956a653648e8 Sep 03 11:30:02.143134 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-d78a215e-21f3-40fc-9998-5adb7f4474ce service neutron] 10.222.0.16 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1571488 Sep 03 11:30:02.323085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:02.325069 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:02.359269 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:02.411630 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Pushing event updated for resources: {'Port': ['ID=5560cb35-25cc-4f08-87c3-68abb05c40aa,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:02.451739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.468028 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-6908c780-339f-4735-897b-a9a895af43b9 service neutron] 10.222.0.16 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3233671 Sep 03 11:30:02.643015 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.644149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:02.645094 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:02.768746 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:02.959344 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cda7cf7e-3c18-4e3c-af2e-46af649d4f07 req-f5c9190d-dd4f-4ecd-8d79-ff8e7f203cd6 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0923758 Sep 03 11:30:02.963350 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:03.073709 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] Pushing event updated for resources: {'Network': ['ID=1e3d2aba-5ac3-475b-872e-956a653648e8,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:03.088134 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e8572912-2e77-4454-b6b5-d01e0323913b admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.7061424 Sep 03 11:30:03.091697 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 1e3d2aba-5ac3-475b-872e-956a653648e8 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:30:03.094933 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58690) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:03.102211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Request body: {'subnet': {'network_id': '1e3d2aba-5ac3-475b-872e-956a653648e8', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1007877178-subnet', 'tenant_id': 'afc73a33624b458192763aa6c8fee813', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:03.144112 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ae5145ed-3930-4c90-9bcc-d551eae70c77 req-f182e4b8-b1d6-4b24-86bb-d5d408f7d151 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0640495 Sep 03 11:30:03.218047 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24c657b3-3eb2-4c04-9440-a2a1cc5d450c None None] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:03.279563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Made reservation on behalf of afc73a33624b458192763aa6c8fee813 for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:03.279563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Notify callbacks [] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.300336 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.558295 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Provisioning for port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:03.566783 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Provisioning complete for port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:03.567263 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.596489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.643054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.720850 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.755398 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Pushing event updated for resources: {'Subnet': ['ID=4d12a051-0764-4f64-a182-837478070955,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:03.763750 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] For port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:03.791576 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Checking segment: {'id': 'e8eadc99-db36-4814-9810-1bea968f621c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1e3d2aba-5ac3-475b-872e-956a653648e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:03.791941 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Network hostable DHCP agents. Network: 1e3d2aba-5ac3-475b-872e-956a653648e8, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:30:03.876769 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:03.905040 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Network 1e3d2aba-5ac3-475b-872e-956a653648e8 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:30:03.905745 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Router cc10d27b-3874-4cbe-8b05-b1194e371752 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94432) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:30:03.936099 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c88392c-3425-4662-8ff8-3af224674618 None None] Pushing event updated for resources: {'Port': ['ID=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:03.997769 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-6e216c6b-e8d9-4732-925c-803c6af62b66 None None] Provisioning complete for port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:03.998279 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6e216c6b-e8d9-4732-925c-803c6af62b66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.003870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 1e3d2aba-5ac3-475b-872e-956a653648e8) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:04.021896 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:04.025792 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.027615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26799a36-de60-4410-ad11-1785a1387922 None None] Network 1e3d2aba-5ac3-475b-872e-956a653648e8 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:04.045146 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:30:04.060290 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:30:04.087964 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:04.088616 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:29:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:04.179964 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.183404 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4468cc91-5f5c-4c31-983e-8a06cef67b36 req-d30f51c8-e7c0-4986-965f-69a69caf4140 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0449574 Sep 03 11:30:04.184052 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-245354d4-52fb-4e7f-baf7-bebecfd4d615 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 4.0808768 Sep 03 11:30:04.184378 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58770) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:04.196363 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-061a0e18-4894-4b64-a2fb-b0edd9a3e85b admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0920787 Sep 03 11:30:04.320216 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:04.326051 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-11713841-842a-4b05-90c0-c2171536d5c7 req-0e4403c8-31b1-49c7-a39a-22243956cd09 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0556090 Sep 03 11:30:04.393093 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a047c6e-9997-4ab5-bb8f-b9eccd2bebfa None None] Network 1e3d2aba-5ac3-475b-872e-956a653648e8 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:04.435846 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58784) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:04.560091 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Deleting subnet 1cb35d32-0e24-4aa5-97d4-f4c21d6cf8f7 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:30:04.566421 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:02Z', 'revision_number': 3, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:04.567150 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.595706 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:30:04.596111 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Updating router cc10d27b-3874-4cbe-8b05-b1194e371752 port 5560cb35-25cc-4f08-87c3-68abb05c40aa binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:30:04.605140 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.615330 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.623895 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.722819 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:04.782710 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:04.783079 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.820102 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.853095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1cb35d32-0e24-4aa5-97d4-f4c21d6cf8f7,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:04.868479 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.870958 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f960ed39-de9e-4f2a-87a5-e539c608818c admin admin] 10.222.0.16 "DELETE /v2.0/subnets/1cb35d32-0e24-4aa5-97d4-f4c21d6cf8f7 HTTP/1.1" status: 204 len: 168 time: 0.4340434 Sep 03 11:30:04.874555 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58798) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:04.886212 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.962923 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.966806 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:04.973465 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Transition to ACTIVE for port object 5560cb35-25cc-4f08-87c3-68abb05c40aa will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:05.043265 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.069282 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.080117 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.080459 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.081260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.081586 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > port after_create 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.081918 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > port after_delete 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.082798 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > port after_update 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.083134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.083483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.083781 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.084094 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.110629 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Pushing event updated for resources: {'Port': ['ID=5560cb35-25cc-4f08-87c3-68abb05c40aa,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:05.121707 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.122977 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.123666 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.124574 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.125117 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.126184 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.126794 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.127495 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.128061 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.128595 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.129155 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.129808 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Tracked resource versions report: Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: pushed versions: Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: { 'AddressGroup': {'1.2'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'ConntrackHelper': {'1.0'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Log': {'1.0'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Network': {'1.1'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Port': {'1.7'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'PortForwarding': {'1.2'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'QosPolicy': {'1.9'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroup': {'1.4'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroupRule': {'1.2'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SubPort': {'1.0'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Subnet': {'1.1'}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Trunk': {'1.1'}} Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: consumer versions: Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: { DHCP agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: HyperV agent@hv-cinder-76019: {}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: L3 agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: Metadata agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: Metering agent@dv-cinder-760199-12-iscsi: {}, Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: Open vSwitch agent@dv-cinder-760199-12-iscsi: { 'AddressGroup': '1.2', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'ConntrackHelper': '1.0', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Log': '1.0', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Network': '1.1', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Port': '1.7', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'PortForwarding': '1.2', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'QosPolicy': '1.9', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroup': '1.4', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SecurityGroupRule': '1.2', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'SubPort': '1.0', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Subnet': '1.1', Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: 'Trunk': '1.1'}} Sep 03 11:30:05.131910 dv-cinder-760199-12-iscsi neutron-server[94435]: {{(pid=94435) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 03 11:30:05.162677 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Attempting to bind port 5560cb35-25cc-4f08-87c3-68abb05c40aa on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:05.164205 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Attempting to bind port 5560cb35-25cc-4f08-87c3-68abb05c40aa by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:05.164810 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Attempting to bind port 5560cb35-25cc-4f08-87c3-68abb05c40aa on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:05.176504 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 29, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:05.176916 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:05.177597 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.178171 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:05.178975 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Bound port: 5560cb35-25cc-4f08-87c3-68abb05c40aa, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:05.179613 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.215307 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Allocated IP 172.20.0.1 (246bd34f-94aa-4eae-85ba-a0f3e2f663ce/d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a/0fd6f549-43c3-4999-89d6-d452bf7f6126) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:05.254740 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.255803 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.256278 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.256879 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=94433) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:30:05.257413 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5c249912-7262-498f-be3f-ef51c0e36269']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:05.272382 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] For port 5560cb35-25cc-4f08-87c3-68abb05c40aa, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:05.275793 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] For port 5560cb35-25cc-4f08-87c3-68abb05c40aa, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5560cb35-25cc-4f08-87c3-68abb05c40aa,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:05.278624 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58808) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:05.293188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '57454036-7c4c-4b28-af2a-cec867b4f781') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:05.293699 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '57454036-7c4c-4b28-af2a-cec867b4f781') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:05.330540 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.336217 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3543f981-1acb-4cb7-b7a7-7f3e76b2d4a0 req-81dc9dbb-61fc-480f-989c-3de1093f7018 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0514629 Sep 03 11:30:05.344360 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.356205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.368097 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Releasing vlan 399 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:30:05.368739 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.369122 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: from cryptography.utils import int_from_bytes Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: from cryptography.utils import int_from_bytes Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:30:05.373632 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:30:05.380474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Transition to ACTIVE for port object 0fd6f549-43c3-4999-89d6-d452bf7f6126 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:05.450527 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f05fd5-e863-45fc-9c69-9f6855165b70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.491936 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:05.492852 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:29:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:05.514983 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.552926 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.576793 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-19908221-ad98-4367-9064-78c2481bd0be req-bd6cc024-b377-451a-bed0-c977b3cb13fa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0509686 Sep 03 11:30:05.576793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.576793 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] 10.222.0.16 "DELETE /v2.0/networks/5c249912-7262-498f-be3f-ef51c0e36269 HTTP/1.1" status: 204 len: 168 time: 0.6899755 Sep 03 11:30:05.576793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58820) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:05.576793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d1a910-141e-4105-9668-0c1c959071b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=5c249912-7262-498f-be3f-ef51c0e36269,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:05.578754 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11defa8b-6a06-46e2-a32c-7f1c13b8e0fe None None] Pushing event updated for resources: {'Port': ['ID=5560cb35-25cc-4f08-87c3-68abb05c40aa,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:05.606999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:05.610815 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:05.615448 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:05.615959 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.659688 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:05.661247 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f05fd5-e863-45fc-9c69-9f6855165b70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.666943 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Deleting subnet 4d12a051-0764-4f64-a182-837478070955 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:30:05.670803 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.715442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.765680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f05fd5-e863-45fc-9c69-9f6855165b70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.810664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b1f05fd5-e863-45fc-9c69-9f6855165b70 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7902df3b15ad4123a175eb5c7b2e2200&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5306971 Sep 03 11:30:05.813897 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58828) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:05.868222 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Pushing event updated for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:05.907985 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.934818 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.953272 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:05.957538 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:02Z', 'revision_number': 3, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:05.986467 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d651253b-b433-4b35-b8bc-cd1db128995b None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:02Z', 'revision_number': 3, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:30:06.003155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f05fd5-e863-45fc-9c69-9f6855165b70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66ab263b-1039-4a37-af02-63aa8ca4f396,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:06.156872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-aa3a1534-af23-4a4a-a458-19f1d27dc972 None None] Provisioning for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:06.157453 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.159790 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.161597 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/66ab263b-1039-4a37-af02-63aa8ca4f396 HTTP/1.1" status: 204 len: 168 time: 0.3470173 Sep 03 11:30:06.162912 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.167098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-aa3a1534-af23-4a4a-a458-19f1d27dc972 None None] Provisioning complete for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:06.167972 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-aa3a1534-af23-4a4a-a458-19f1d27dc972 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.208574 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.211371 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] 10.222.0.16 "DELETE /v2.0/subnets/4d12a051-0764-4f64-a182-837478070955 HTTP/1.1" status: 204 len: 168 time: 0.6414678 Sep 03 11:30:06.214507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58836) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:06.221290 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-aa3a1534-af23-4a4a-a458-19f1d27dc972 None None] Port 0fd6f549-43c3-4999-89d6-d452bf7f6126 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:30:06.271956 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.278714 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc7681e-a818-40fc-8d9f-72652157bcdc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4d12a051-0764-4f64-a182-837478070955,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:06.343891 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ed8472-fda1-4191-b76a-18ebbff0f82d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66ab263b-1039-4a37-af02-63aa8ca4f396,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:06.451464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.520142 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-853e7d86-8f99-4dac-a97f-ce33eecaee17 req-bea7e018-7ee1-4755-b7fa-d5211dde0822 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0545580 Sep 03 11:30:06.605765 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.608780 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.617190 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e3d2aba-5ac3-475b-872e-956a653648e8']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:06.630877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8eadc99-db36-4814-9810-1bea968f621c') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:06.631353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8eadc99-db36-4814-9810-1bea968f621c') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:06.642333 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.665699 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.706246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.707088 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.719012 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Releasing vlan 381 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:30:06.720301 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:30:06.722581 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:30:06.752830 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af6cb72d-1aba-4151-b183-84580e9bb565 req-2acb59bc-2e52-4651-9a8e-139a36b086cf tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0691316 Sep 03 11:30:06.844809 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5560cb35-25cc-4f08-87c3-68abb05c40aa up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:06.886095 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Pushing event updated for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:06.905386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.912815 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:06.916724 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] 10.222.0.16 "DELETE /v2.0/networks/1e3d2aba-5ac3-475b-872e-956a653648e8 HTTP/1.1" status: 204 len: 168 time: 0.6652544 Sep 03 11:30:06.931697 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5f0e1f-882c-44f9-b1b4-8f5e7b0a1bc0 admin admin] Pushing event deleted for resources: {'Network': ['ID=1e3d2aba-5ac3-475b-872e-956a653648e8,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:06.956688 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:06.959244 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:06.992721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 5560cb35-25cc-4f08-87c3-68abb05c40aa completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:07.002017 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 5560cb35-25cc-4f08-87c3-68abb05c40aa triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:07.002409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.183709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.186214 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:30:07.227770 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 5560cb35-25cc-4f08-87c3-68abb05c40aa, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5560cb35-25cc-4f08-87c3-68abb05c40aa,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:07.325469 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58878) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:07.346208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d9067d5f-588f-4271-8932-4573ab600c2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.360355 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-6b4fb5f8-b42e-4e20-b607-2182e4d170c8 None None] Provisioning complete for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:07.360725 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6b4fb5f8-b42e-4e20-b607-2182e4d170c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.366963 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.387555 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:30:07.419643 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-dfff6c03-69dc-4e1f-be14-2e8b97f3cb64 admin admin] 10.222.0.16 "PUT /v2.0/routers/cc10d27b-3874-4cbe-8b05-b1194e371752/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2325473 Sep 03 11:30:07.432759 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.11', 57447) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:07.569111 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-6b4fb5f8-b42e-4e20-b607-2182e4d170c8 None None] Port 0fd6f549-43c3-4999-89d6-d452bf7f6126 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:30:07.588445 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d9067d5f-588f-4271-8932-4573ab600c2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.612177 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=5560cb35-25cc-4f08-87c3-68abb05c40aa,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:07.665987 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58900) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:07.681540 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d9067d5f-588f-4271-8932-4573ab600c2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.777069 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d9067d5f-588f-4271-8932-4573ab600c2c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=4bd447d074384d97ba9f0b47ecb66677&name=default HTTP/1.1" status: 200 len: 2975 time: 0.4494259 Sep 03 11:30:07.777804 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 58904) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:07.794902 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9067d5f-588f-4271-8932-4573ab600c2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72672b8a-73cf-4f76-ac3d-940abdb30b17,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:07.812142 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fee3ba8e-e7cd-448c-adbc-06e270bdce26 req-a586f483-74a8-4644-9e94-0218c4384bda tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0633774 Sep 03 11:30:07.835607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58908) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:07.835853 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f893a4f5-3399-4f0a-a597-b0d3d6560169 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=236b2bd6994a4cb68504a40e24177949&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1637194 Sep 03 11:30:07.889408 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.997051 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:07.998662 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-ea98a9d7-d8e2-4289-a492-1161b7e03059 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:07.998662 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-ea98a9d7-d8e2-4289-a492-1161b7e03059 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.5467384 Sep 03 11:30:08.006390 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eb761eac-5de1-4f00-bfbf-9096912a2168 req-44a9b113-34eb-44e1-8cc6-db273c21a5aa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0426290 Sep 03 11:30:08.053073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.063875 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Request body: {'port': {'device_id': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'admin_state_up': True, 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:08.188872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.260462 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.263766 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.264800 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/72672b8a-73cf-4f76-ac3d-940abdb30b17 HTTP/1.1" status: 204 len: 168 time: 0.4665072 Sep 03 11:30:08.282256 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53c7359-969f-49b8-ade4-8514adb65274 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72672b8a-73cf-4f76-ac3d-940abdb30b17,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:08.497254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:30:08.505870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.11', 57454) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:08.508130 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:08.508928 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:29:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:08.568900 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.572728 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.574425 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/daae43c2-d4cd-4f35-9fdb-ae4acee4769e HTTP/1.1" status: 204 len: 168 time: 0.7369430 Sep 03 11:30:08.584474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:08.584474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:08.613695 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ba9d96-3630-467a-83e0-8d115096ae76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=daae43c2-d4cd-4f35-9fdb-ae4acee4769e,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:08.666583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-f4451807-dab3-4190-a34c-d618e38fb4aa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:08.669887 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-f4451807-dab3-4190-a34c-d618e38fb4aa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.11 "GET /v2.0/networks?id=e4ae560a-b704-4763-8338-c0b652784a4f HTTP/1.1" status: 200 len: 812 time: 0.1629920 Sep 03 11:30:08.698499 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Request body: {'port': {'device_id': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f', 'admin_state_up': True, 'tenant_id': '74f263fc57094cad9ed742802a83bff8'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:08.714952 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58948) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:08.733905 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1733315037', 'description': 'tempest-description--12773451'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:08.791790 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:08.842118 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5560cb35-25cc-4f08-87c3-68abb05c40aa up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:08.935370 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Allocated IP 172.20.0.2 (778c15f4-3719-4d66-9e6d-1be38ac5cc42/c64b6662-4e29-47d5-96b7-4719ce1edb33/f7000a32-aed7-401d-8575-3a956bbb5eb8) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:09.008332 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 5560cb35-25cc-4f08-87c3-68abb05c40aa triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:09.012996 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.092767 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a452b1f3-b4d8-41ef-a9a6-ecc1e2b3e343 req-1596fbd9-bb3f-4afa-b4ef-e516b79ab0ec tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 210 time: 0.0720298 Sep 03 11:30:09.141118 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 2, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:09.173959 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:30:09.174329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Updating router cc10d27b-3874-4cbe-8b05-b1194e371752 port 0fd6f549-43c3-4999-89d6-d452bf7f6126 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:30:09.206413 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.232348 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-62bd5a89-84fb-48b7-8291-b6108dcdb388 req-ad54581c-a715-4a72-9465-086f810b0848 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0559273 Sep 03 11:30:09.251493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Made reservation on behalf of 74f263fc57094cad9ed742802a83bff8 for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:09.251493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.387816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 58966) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:09.388872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.507672 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.605823 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.646877 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.658007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Allocated IP 172.20.0.9 (e4ae560a-b704-4763-8338-c0b652784a4f/6c707ad6-c2c1-4d5a-a165-571e0df41796/1787e601-3fc1-4b10-b40f-019d14b569a6) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:09.940531 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Transition to ACTIVE for port object 0fd6f549-43c3-4999-89d6-d452bf7f6126 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:09.944345 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.944345 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.945408 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.945408 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931d3de1-cbb6-417b-8c90-51af3947cda0 None None] Pushing event updated for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:09.958447 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Attempting to bind port 0fd6f549-43c3-4999-89d6-d452bf7f6126 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:09.958860 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Attempting to bind port 0fd6f549-43c3-4999-89d6-d452bf7f6126 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:09.959909 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Attempting to bind port 0fd6f549-43c3-4999-89d6-d452bf7f6126 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:09.970625 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 29, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:09.971002 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Checking segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:09.971409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.971810 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Bound using segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:09.997201 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Bound port: 0fd6f549-43c3-4999-89d6-d452bf7f6126, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:09.997201 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:09.998054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.018288 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event updated for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:10.033655 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2f14be47-24c5-49ca-a44a-099753bb83cf admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.053927 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:10.054881 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroup': ['ID=726fd293-a4b6-41bd-86f0-08e2e13f4a9f,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:10.061199 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] For port 0fd6f549-43c3-4999-89d6-d452bf7f6126, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:10.067599 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] For port 0fd6f549-43c3-4999-89d6-d452bf7f6126, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0fd6f549-43c3-4999-89d6-d452bf7f6126,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:10.072252 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:10.074879 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:10.081700 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:10.083826 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.091265 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.094416 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c8111f45-61d2-41d1-a0a9-4ce656decedc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1776 time: 1.3637431 Sep 03 11:30:10.096486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59014) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:10.105393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group_rule': {'security_group_id': '726fd293-a4b6-41bd-86f0-08e2e13f4a9f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:10.203721 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2f14be47-24c5-49ca-a44a-099753bb83cf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.218346 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.244243 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.311996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2f14be47-24c5-49ca-a44a-099753bb83cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.363169 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Network e4ae560a-b704-4763-8338-c0b652784a4f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:10.365486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:10.377276 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:10.380979 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-931d3de1-cbb6-417b-8c90-51af3947cda0 None None] Pushing event updated for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:10.409090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:10.410160 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:29:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:10.424911 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7c8a0656-c3d0-48c5-973f-02ac38f7c35d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3737164 Sep 03 11:30:10.445700 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-2f14be47-24c5-49ca-a44a-099753bb83cf admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=609442580b484156827b37a2cd837f5b&name=default HTTP/1.1" status: 200 len: 2975 time: 1.0505829 Sep 03 11:30:10.445700 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f14be47-24c5-49ca-a44a-099753bb83cf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=239120cc-369a-480f-bb6c-dfc4ec5507d2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:10.448688 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59024) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:10.460814 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:10.464268 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.468717 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-4cef1157-b177-4255-a91a-383d6a62995d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:30:10.506777 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-4cef1157-b177-4255-a91a-383d6a62995d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0297022 Sep 03 11:30:10.545685 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Pushing event updated for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:10.557018 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59028) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:10.609899 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec8b66ed-e915-499d-9f41-2e29d646cdc1 req-54eb434d-f77e-4aa1-a9f8-c7b28a6acd62 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:10.612810 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec8b66ed-e915-499d-9f41-2e29d646cdc1 req-54eb434d-f77e-4aa1-a9f8-c7b28a6acd62 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 931 time: 0.4385633 Sep 03 11:30:10.706129 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.727879 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:10.768701 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-4bb7a459-145f-4142-8502-1097a0279bed admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=afc73a33624b458192763aa6c8fee813&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1897535 Sep 03 11:30:10.784287 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59030) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:10.828569 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.860273 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75b196b-46b9-4971-bac7-0eb107dc2190 req-d16ef855-1e5f-44eb-8f38-4ac29fb5d141 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:10.862231 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a75b196b-46b9-4971-bac7-0eb107dc2190 req-d16ef855-1e5f-44eb-8f38-4ac29fb5d141 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 931 time: 0.5101950 Sep 03 11:30:10.881468 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec8b66ed-e915-499d-9f41-2e29d646cdc1 req-3b1bf7d9-361c-4645-8d90-eb6bd09522d8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1991975 Sep 03 11:30:10.952834 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:10.974604 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a75b196b-46b9-4971-bac7-0eb107dc2190 req-afd5991a-4f97-46a2-955b-5b9a282627d8 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860164 Sep 03 11:30:11.046841 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.054764 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.125440 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.141133 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.142568 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/239120cc-369a-480f-bb6c-dfc4ec5507d2 HTTP/1.1" status: 204 len: 168 time: 0.6646707 Sep 03 11:30:11.152612 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-9143d4f9-2b76-4ee9-a5f1-55af65021cfa tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4704239 Sep 03 11:30:11.196118 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-397649a7-2607-486b-9f88-4011ad1ee1c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=239120cc-369a-480f-bb6c-dfc4ec5507d2,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:11.265101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.292749 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.311806 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:10Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:11.316699 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.319332 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.323798 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9b5701f6-96b7-49aa-a0d7-bbd0c180d478 HTTP/1.1" status: 204 len: 168 time: 0.5359452 Sep 03 11:30:11.334813 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffcc878b-d3d7-47a3-a853-7178d5edd927 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b5701f6-96b7-49aa-a0d7-bbd0c180d478,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:11.360534 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e0c6266-1b93-43bf-9759-63c515171a71 None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:10Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:30:11.362466 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.420747 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c768030e-3955-43fe-ac5e-cec6164eb0ce,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:11.479997 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Request body: {'port': {'device_id': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:11.525895 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Request body: {'port': {'device_id': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:11.587326 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.592592 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e0ad622d-61df-4536-b790-ab085eca8711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.4948497 Sep 03 11:30:11.593279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59064) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:11.610991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group_rule': {'security_group_id': '726fd293-a4b6-41bd-86f0-08e2e13f4a9f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:11.611670 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.716385 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.790139 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:11.840504 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59072) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:12.022505 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.107442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.204195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4a414c23-196b-4ce5-822b-08288209b7a8,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:12.362073 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5971dc1f-2518-4464-8dd8-05696875a7a6 req-ecf0c794-b464-4b84-a923-6c828e1e4faf tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:12.364539 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5971dc1f-2518-4464-8dd8-05696875a7a6 req-ecf0c794-b464-4b84-a923-6c828e1e4faf tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 931 time: 0.1624231 Sep 03 11:30:12.400112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9888dc1-6dc3-4432-9de9-df2a444dd575 req-9615ef8a-aa1b-4b95-a781-cabc85497869 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:12.403568 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d9888dc1-6dc3-4432-9de9-df2a444dd575 req-9615ef8a-aa1b-4b95-a781-cabc85497869 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 931 time: 0.3196559 Sep 03 11:30:12.478168 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f7000a32-aed7-401d-8575-3a956bbb5eb8 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:12.488893 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.510015 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.510758 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6b5b9e7d-e756-4593-962f-8acefa1fe957 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9135871 Sep 03 11:30:12.519771 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59088) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:12.529159 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:12.553535 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Transition to ACTIVE for port object f7000a32-aed7-401d-8575-3a956bbb5eb8 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:12.574585 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5971dc1f-2518-4464-8dd8-05696875a7a6 req-42ad3f5f-5066-4c4e-8654-308490e3a59a tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1843846 Sep 03 11:30:12.606620 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d9888dc1-6dc3-4432-9de9-df2a444dd575 req-052166ee-f553-4d34-b03a-771e8c2b8c88 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1893399 Sep 03 11:30:12.644114 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.659678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1787e601-3fc1-4b10-b40f-019d14b569a6 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:12.677354 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.725506 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Transition to ACTIVE for port object 1787e601-3fc1-4b10-b40f-019d14b569a6 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:12.729644 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Pushing event updated for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:12.750804 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.786705 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:12.966995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0fd6f549-43c3-4999-89d6-d452bf7f6126 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:12.978611 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Pushing event updated for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:13.012464 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Attempting to bind port f7000a32-aed7-401d-8575-3a956bbb5eb8 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:13.013442 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Attempting to bind port f7000a32-aed7-401d-8575-3a956bbb5eb8 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:13.013961 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Attempting to bind port f7000a32-aed7-401d-8575-3a956bbb5eb8 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:13.042402 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Port f7000a32-aed7-401d-8575-3a956bbb5eb8 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:30:13.048497 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Attempting to bind port f7000a32-aed7-401d-8575-3a956bbb5eb8 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:13.176032 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Attempting to bind port 1787e601-3fc1-4b10-b40f-019d14b569a6 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:13.176614 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Attempting to bind port 1787e601-3fc1-4b10-b40f-019d14b569a6 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:13.179819 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Attempting to bind port 1787e601-3fc1-4b10-b40f-019d14b569a6 on network e4ae560a-b704-4763-8338-c0b652784a4f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:13.204027 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Port 1787e601-3fc1-4b10-b40f-019d14b569a6 on network e4ae560a-b704-4763-8338-c0b652784a4f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:30:13.204383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Attempting to bind port 1787e601-3fc1-4b10-b40f-019d14b569a6 on network e4ae560a-b704-4763-8338-c0b652784a4f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:13.213270 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 30, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:13.213624 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Checking segment: {'id': '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:13.221381 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Bound using segment: {'id': '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:13.221938 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Bound port: 1787e601-3fc1-4b10-b40f-019d14b569a6, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:13.222503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.229944 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 30, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:13.230299 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Checking segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:13.232334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Bound using segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:13.234083 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Bound port: f7000a32-aed7-401d-8575-3a956bbb5eb8, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:13.234523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.313509 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-4c67411f-5b45-40f3-ac2b-87142df36906 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.491377 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:13.518485 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1787e601-3fc1-4b10-b40f-019d14b569a6,segment=NetworkSegment(8483a2f2-1768-46a2-b6ca-7df7e3ec18b3),segment_id=8483a2f2-1768-46a2-b6ca-7df7e3ec18b3)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:13.596724 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:13.606043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:13.606043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.627887 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.664731 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-4c67411f-5b45-40f3-ac2b-87142df36906 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.824183 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-4c67411f-5b45-40f3-ac2b-87142df36906 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:13.993013 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.105411 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:14.105821 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.107301 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] 10.222.0.11 "PUT /v2.0/ports/1787e601-3fc1-4b10-b40f-019d14b569a6 HTTP/1.1" status: 200 len: 1093 time: 2.9238372 Sep 03 11:30:14.120094 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:14.130789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 0fd6f549-43c3-4999-89d6-d452bf7f6126, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0fd6f549-43c3-4999-89d6-d452bf7f6126,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:14.195760 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc1602b-7d72-4e94-ae5f-9b8e2abb90b6 service neutron] Pushing event updated for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:14.209271 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.225026 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e743a0dd-4539-4a23-9350-0aea5a57b757 req-f94b03f6-8fc7-4a1a-9c2d-b20b276646e7 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:14.227012 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e743a0dd-4539-4a23-9350-0aea5a57b757 req-f94b03f6-8fc7-4a1a-9c2d-b20b276646e7 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.4272027 Sep 03 11:30:14.229824 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-4c67411f-5b45-40f3-ac2b-87142df36906 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=993d4ece44c24aca85a6b575504128f3&name=default HTTP/1.1" status: 200 len: 2977 time: 2.3881750 Sep 03 11:30:14.235038 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59122) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:14.250687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.259287 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b6c456-021e-485e-b194-26933f762bd7 req-dbf15496-c743-46e2-88c0-c9124f49995f tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:14.259978 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:14.266259 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c67411f-5b45-40f3-ac2b-87142df36906 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d89d91b3-0f5c-434b-a6d9-e28d3638b10c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:14.267598 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e5b6c456-021e-485e-b194-26933f762bd7 req-dbf15496-c743-46e2-88c0-c9124f49995f tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.2049229 Sep 03 11:30:14.355006 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:14.554814 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:14.574767 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Allocated IP 172.27.0.120 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:14.672577 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.767331 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:14.768102 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:14.770328 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] 10.222.0.11 "PUT /v2.0/ports/f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 200 len: 1093 time: 3.6568389 Sep 03 11:30:14.772605 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:14.793120 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e5b6c456-021e-485e-b194-26933f762bd7 req-98c3eda9-c0de-4691-9184-843a4e434967 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5211232 Sep 03 11:30:14.845432 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e743a0dd-4539-4a23-9350-0aea5a57b757 req-4cd49ddb-a8f8-43c1-aefe-fefaf88ad1b6 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5382590 Sep 03 11:30:14.875801 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0fd6f549-43c3-4999-89d6-d452bf7f6126 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:14.935787 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-eedfd8e9-6c69-474b-92b4-41101cd5c601 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:14.947319 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-eedfd8e9-6c69-474b-92b4-41101cd5c601 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=74f263fc57094cad9ed742802a83bff8&device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 1096 time: 0.6564901 Sep 03 11:30:14.948527 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.027541 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 0fd6f549-43c3-4999-89d6-d452bf7f6126 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:15.028023 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.083323 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b235db4e-a85d-4549-b0ce-0dde07345f12 service neutron] Pushing event updated for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:15.096983 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425" -d '{"events": [{"name": "network-changed", "server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:15.165908 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.182330 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-f462806d-c7be-46d2-a81d-4334ef1e8f68 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1787e601-3fc1-4b10-b40f-019d14b569a6 HTTP/1.1" status: 200 len: 217 time: 0.2043719 Sep 03 11:30:15.258075 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.294669 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-a5e7e347-8bb5-450a-bdce-29bd4e11a7ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:15.296477 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-a5e7e347-8bb5-450a-bdce-29bd4e11a7ae service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 1096 time: 0.4022434 Sep 03 11:30:15.426860 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-e0e842ba-b564-43e9-aab9-159508645b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:15.426860 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-e0e842ba-b564-43e9-aab9-159508645b44 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6c707ad6-c2c1-4d5a-a165-571e0df41796 HTTP/1.1" status: 200 len: 852 time: 0.0885396 Sep 03 11:30:15.426860 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-74fdcea2-fe86-4856-b019-3122edbf5e23 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=e4ae560a-b704-4763-8338-c0b652784a4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0543563 Sep 03 11:30:15.568354 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.571741 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:15.576665 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/d89d91b3-0f5c-434b-a6d9-e28d3638b10c HTTP/1.1" status: 204 len: 168 time: 1.3375750 Sep 03 11:30:15.588011 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3015d53-ca23-4119-85e6-f3164766011c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d89d91b3-0f5c-434b-a6d9-e28d3638b10c,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:15.629323 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc" -d '{"events": [{"name": "network-changed", "server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:15.637189 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a38fb2d3-8728-4b82-bff9-18fbb0ef4bdc x-openstack-request-id: req-a38fb2d3-8728-4b82-bff9-18fbb0ef4bdc {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:15.637985 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:15.639930 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a38fb2d3-8728-4b82-bff9-18fbb0ef4bdc {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:15.644378 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6', 'status': 'completed', 'code': 200} Sep 03 11:30:15.656391 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-d2c4f9b2-347f-4362-b735-50f89abfb819 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 200 len: 217 time: 0.3278804 Sep 03 11:30:15.957939 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.011724 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:16.015589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:16.028354 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:16.040386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec68109a-d609-4bc7-aec6-29c763b0ecd1 req-b63e8f12-1e87-4fec-bcc7-42bc280b504c tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:16.042673 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec68109a-d609-4bc7-aec6-29c763b0ecd1 req-b63e8f12-1e87-4fec-bcc7-42bc280b504c tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.1127670 Sep 03 11:30:16.086358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:16.123272 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec68109a-d609-4bc7-aec6-29c763b0ecd1 req-4434ae86-e9bf-4a67-bda7-5403c4345ca4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691743 Sep 03 11:30:16.166269 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03ef5a38-1786-4208-b5bd-d9761abd2dc8 x-openstack-request-id: req-03ef5a38-1786-4208-b5bd-d9761abd2dc8 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:16.168291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:16.168552 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-03ef5a38-1786-4208-b5bd-d9761abd2dc8 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:16.169019 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8', 'status': 'completed', 'code': 200} Sep 03 11:30:16.173735 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.295155 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.335351 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0c3dc3-33d2-43ec-a3f8-60ae0ed843ab req-f1a33e12-bdc6-449f-be8b-f4a2a36ef202 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:16.336827 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6c0c3dc3-33d2-43ec-a3f8-60ae0ed843ab req-f1a33e12-bdc6-449f-be8b-f4a2a36ef202 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.1042633 Sep 03 11:30:16.422030 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6c0c3dc3-33d2-43ec-a3f8-60ae0ed843ab req-39520810-8e27-4a60-8e4c-03a8f7983d9c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691628 Sep 03 11:30:16.717116 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.864756 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.934897 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:16.960634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:17.174080 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:17.177117 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-23674a5b-9e8a-49f1-858a-9922ab5183ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.6546607 Sep 03 11:30:17.337670 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4ba7df-3ee5-4565-a6f3-836f060d1766 req-e9f9f91c-9126-4c69-bde9-9a9b62c81cb2 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:17.339333 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cc4ba7df-3ee5-4565-a6f3-836f060d1766 req-e9f9f91c-9126-4c69-bde9-9a9b62c81cb2 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.0823107 Sep 03 11:30:17.398644 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cc4ba7df-3ee5-4565-a6f3-836f060d1766 req-3d96e7a8-32b8-47cd-b8d3-1c37580c5394 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516865 Sep 03 11:30:17.540340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5a6e07e7-5937-4afd-8a2d-509d4e84a843 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--1733315037&fields=id&tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 267 time: 0.0498815 Sep 03 11:30:17.737896 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-72811198-4e0c-4780-ae7a-b88adc071153 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:17.744703 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-72811198-4e0c-4780-ae7a-b88adc071153 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 809 time: 0.1844921 Sep 03 11:30:17.809443 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-df7a1a17-682e-4eae-ba3a-8f752226c462 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/quotas/8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 375 time: 0.0638082 Sep 03 11:30:17.819243 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685094bb-8331-41e4-869b-bf9e32a005bc req-b6cee8d5-9b70-4dd9-bdaf-59d921280836 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:17.826905 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-685094bb-8331-41e4-869b-bf9e32a005bc req-b6cee8d5-9b70-4dd9-bdaf-59d921280836 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.1115069 Sep 03 11:30:17.956209 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-685094bb-8331-41e4-869b-bf9e32a005bc req-a1f2e7fb-5a8a-406a-86b8-983565bae747 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787179 Sep 03 11:30:17.956209 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-57c19bad-cd8d-4db4-9ea2-8ff913a1595b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1201856 Sep 03 11:30:18.065665 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-f11e2262-ec08-4ade-8d1f-f159819ba511 service neutron] 10.222.0.16 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1214852 Sep 03 11:30:18.219762 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-4a1ae265-ca45-4ea0-9a28-5d60bb9a0a3e service neutron] 10.222.0.16 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1452138 Sep 03 11:30:18.523775 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de1078a-f6e2-4a62-b005-876616c20960 req-511b1472-c7e1-417c-a47e-7556e8a65dc5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:18.536922 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8de1078a-f6e2-4a62-b005-876616c20960 req-511b1472-c7e1-417c-a47e-7556e8a65dc5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.0587609 Sep 03 11:30:18.629231 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8de1078a-f6e2-4a62-b005-876616c20960 req-8b183a6f-06e6-45ee-8a9e-753d2eff33a3 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491252 Sep 03 11:30:18.702028 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1ff8767d-00a7-4e54-b912-d6e72afa8d03 req-8e9b56a4-1717-4e8f-b5a0-a20038810e13 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0279565 Sep 03 11:30:19.120488 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4cb76f-9baa-4180-9156-79fd36491c67 req-741e81e5-04a8-4a69-8bcd-47debecc38cb tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:19.121573 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db4cb76f-9baa-4180-9156-79fd36491c67 req-741e81e5-04a8-4a69-8bcd-47debecc38cb tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.0996647 Sep 03 11:30:19.189588 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db4cb76f-9baa-4180-9156-79fd36491c67 req-2b4a17c3-fe49-46d6-83d7-3336e2bc3e65 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673606 Sep 03 11:30:19.256778 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59302) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:19.694106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-08f8994b-9e95-43c6-a2ea-f3cd76d44bd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:19.836218 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-08f8994b-9e95-43c6-a2ea-f3cd76d44bd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:19.838734 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fd8e0ac8-b475-448c-964e-9026f8d8fea1 req-5cc75253-e616-4532-b777-8cd5f4e84a5a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0458496 Sep 03 11:30:19.861928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a5230ce-5887-460c-ab55-f0571596b5cf req-9ffd1d02-45c4-421c-94a1-3a3135624316 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:19.861928 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a5230ce-5887-460c-ab55-f0571596b5cf req-9ffd1d02-45c4-421c-94a1-3a3135624316 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.1077657 Sep 03 11:30:19.947535 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a5230ce-5887-460c-ab55-f0571596b5cf req-ea0b6e67-4323-4169-be3a-c4bcaa1182f4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633450 Sep 03 11:30:20.088027 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-08f8994b-9e95-43c6-a2ea-f3cd76d44bd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:20.136207 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-08f8994b-9e95-43c6-a2ea-f3cd76d44bd2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=187d99e7421040609ed3e61a22712a67&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8766418 Sep 03 11:30:20.137303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f8994b-9e95-43c6-a2ea-f3cd76d44bd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbd6772e-0871-4110-a39d-a4834fe46dc6,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:20.139276 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59334) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:20.255012 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:20.278961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:20.392668 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95dedc2-8d6b-48b7-82e2-cb226db23732 req-aedc89a7-a68d-49e1-9987-b38097710d29 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:20.396415 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c95dedc2-8d6b-48b7-82e2-cb226db23732 req-aedc89a7-a68d-49e1-9987-b38097710d29 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.1004627 Sep 03 11:30:20.431996 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:20.435357 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:20.438219 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/dbd6772e-0871-4110-a39d-a4834fe46dc6 HTTP/1.1" status: 204 len: 168 time: 0.2967081 Sep 03 11:30:20.458685 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c95dedc2-8d6b-48b7-82e2-cb226db23732 req-27f213cc-e08d-4b07-9b64-76329229f2e2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556276 Sep 03 11:30:20.466569 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39fbfa82-72c1-460f-9c07-10f78708575e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbd6772e-0871-4110-a39d-a4834fe46dc6,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:20.947188 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-779ce52c-ce16-4c95-ac89-3d8ac25544f1 req-7a83fed6-a402-4bd2-b172-273bb7d24c93 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0310702 Sep 03 11:30:21.094502 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb846e0-1f22-4fef-914b-de04f718509b req-bd88f00b-6b4c-48af-a519-a0a7f7be24b4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:21.103545 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-adb846e0-1f22-4fef-914b-de04f718509b req-bd88f00b-6b4c-48af-a519-a0a7f7be24b4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.0712402 Sep 03 11:30:21.152698 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-adb846e0-1f22-4fef-914b-de04f718509b req-38407e23-e555-4220-9d55-7e0d589c10d5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458951 Sep 03 11:30:21.610146 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0201616-0e4d-4d05-97f5-3510b26a3dec req-33a16e22-4845-4442-9c5d-2fff03107e9f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:21.618038 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0201616-0e4d-4d05-97f5-3510b26a3dec req-33a16e22-4845-4442-9c5d-2fff03107e9f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.0601337 Sep 03 11:30:21.664197 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0201616-0e4d-4d05-97f5-3510b26a3dec req-730b5021-2bcc-468c-b9e3-76f9bf47d7ff tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452290 Sep 03 11:30:21.864727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59404) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:22.001448 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-450f2ee5-7b25-4d22-b34f-1b3b784476f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.063286 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7dcecffe-e09e-46cb-a0c5-9ea5465d65c7 req-420056bb-95f9-4c06-9d94-a3560ae33587 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0314593 Sep 03 11:30:22.126560 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-450f2ee5-7b25-4d22-b34f-1b3b784476f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.196578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-450f2ee5-7b25-4d22-b34f-1b3b784476f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.261066 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-450f2ee5-7b25-4d22-b34f-1b3b784476f4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=63307d2abd56428b83691199c202b8f3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3951607 Sep 03 11:30:22.263290 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450f2ee5-7b25-4d22-b34f-1b3b784476f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02b7f0a4-f553-46ed-8496-4089f01a1f4e,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:22.263701 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59422) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:22.288724 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b93a10-bf66-40c1-a661-bbb8acdae099 req-e548971e-4afc-48cd-8dff-ddfec10baabf tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:22.290212 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8b93a10-bf66-40c1-a661-bbb8acdae099 req-e548971e-4afc-48cd-8dff-ddfec10baabf tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.0732138 Sep 03 11:30:22.313475 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.331110 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8b93a10-bf66-40c1-a661-bbb8acdae099 req-dc59f0f1-84ab-4823-ab65-85392b50a65a tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346324 Sep 03 11:30:22.336197 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.467734 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7b15a066-a0eb-4ca7-ad3c-4874e1538d76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:22.469234 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-7b15a066-a0eb-4ca7-ad3c-4874e1538d76 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0649962 Sep 03 11:30:22.469802 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-56e7dae8-a4ed-4c81-bae7-f184d61b0a6f service neutron] 10.222.0.11 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0994277 Sep 03 11:30:22.482149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.485076 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:22.486262 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/02b7f0a4-f553-46ed-8496-4089f01a1f4e HTTP/1.1" status: 204 len: 168 time: 0.2215319 Sep 03 11:30:22.523997 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b33215c-4a4a-4cae-872c-955bacc1ea2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02b7f0a4-f553-46ed-8496-4089f01a1f4e,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:22.554303 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-07e2518a-672e-4a1a-b853-9cbaaad4e906 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0644588 Sep 03 11:30:22.640724 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fb21e8a-9838-4621-ba2c-302cd06cc805 req-579757df-4d47-4303-99f0-57a7c61f83a0 service neutron] 10.222.0.11 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1475780 Sep 03 11:30:22.713994 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-4c14ac90-6ed6-46ff-ab8e-932c9ffcf9b7 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1484339 Sep 03 11:30:22.890144 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7044b60d-a4f4-4ac7-9c5c-8cb570cf806a req-25cbc344-bb59-4294-9791-ed1b2c717315 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1675844 Sep 03 11:30:22.943129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07354b31-82a8-44cb-ab43-adb9acd17b71 req-23e96de3-80a6-4ae3-8011-890f4eb0b902 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:22.947447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-07354b31-82a8-44cb-ab43-adb9acd17b71 req-23e96de3-80a6-4ae3-8011-890f4eb0b902 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.1425631 Sep 03 11:30:22.976669 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-87499d6c-7e56-4e02-b674-5c5ffe1f0196 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:22.978171 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-87499d6c-7e56-4e02-b674-5c5ffe1f0196 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=74f263fc57094cad9ed742802a83bff8&device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 1096 time: 0.0886059 Sep 03 11:30:23.113622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-22d2a83d-89ec-458b-b0e5-cac1cc15f324 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.113622 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-22d2a83d-89ec-458b-b0e5-cac1cc15f324 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 1096 time: 0.1132934 Sep 03 11:30:23.119114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-07354b31-82a8-44cb-ab43-adb9acd17b71 req-ea4adae4-4889-4b44-b894-56ac75e3308a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1576655 Sep 03 11:30:23.262747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59480) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:23.299989 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6517902-8dcc-4a3f-bc63-2bfd48358515 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:23.466493 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c699385d-fc99-4576-b376-93cbac111886 req-cdb3428a-e421-495e-b3d4-a4bf698d124e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.2846794 Sep 03 11:30:23.502182 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-3f9ec3cb-a411-4207-93f7-a409b73ac7eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.506169 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-3f9ec3cb-a411-4207-93f7-a409b73ac7eb service neutron] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 916 time: 0.3813546 Sep 03 11:30:23.549727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-763a20de-8b80-4a1c-ae83-3dbe97fdc9c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.551994 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-763a20de-8b80-4a1c-ae83-3dbe97fdc9c0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=e4ae560a-b704-4763-8338-c0b652784a4f HTTP/1.1" status: 200 len: 913 time: 0.5402029 Sep 03 11:30:23.565369 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-3e6748c7-5ed3-440e-93a1-efc1157a31cc service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 200 len: 217 time: 0.0502975 Sep 03 11:30:23.565887 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.11', 57476) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:23.571142 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47401d71-72bf-40c0-b16d-ae4b59794826 req-88205b57-edba-484c-8095-dd782810aea9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.572841 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-47401d71-72bf-40c0-b16d-ae4b59794826 req-88205b57-edba-484c-8095-dd782810aea9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 943 time: 0.0934770 Sep 03 11:30:23.617482 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-664be282-3a2e-47d7-ba02-b75ffa494778 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1787e601-3fc1-4b10-b40f-019d14b569a6 HTTP/1.1" status: 200 len: 217 time: 0.0433733 Sep 03 11:30:23.621125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6517902-8dcc-4a3f-bc63-2bfd48358515 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:23.653947 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-68fc86f2-a252-4c4d-b39a-dfe4c383f09b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:23.677736 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-47401d71-72bf-40c0-b16d-ae4b59794826 req-2cc17b9d-5060-477d-9035-f4afcb2fcfec tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966017 Sep 03 11:30:23.687485 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-691667ce-f3c2-44c5-8f03-f8da58f95399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.688925 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-691667ce-f3c2-44c5-8f03-f8da58f95399 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6c707ad6-c2c1-4d5a-a165-571e0df41796 HTTP/1.1" status: 200 len: 852 time: 0.0639670 Sep 03 11:30:23.705710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6517902-8dcc-4a3f-bc63-2bfd48358515 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:23.721686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-63c4d990-6503-4b4c-8af5-86ffefc29859 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.723490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-e967ce8b-b45d-4b36-89b4-02c716df79d0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=e4ae560a-b704-4763-8338-c0b652784a4f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261049 Sep 03 11:30:23.724346 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-63c4d990-6503-4b4c-8af5-86ffefc29859 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.1410201 Sep 03 11:30:23.776375 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a6517902-8dcc-4a3f-bc63-2bfd48358515 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=84603f46ef82475c9085d60520c90c6c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5123672 Sep 03 11:30:23.793492 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59492) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:23.795524 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-c8f2b2c4-5ee6-4fd1-bbb7-951f87546933 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0524187 Sep 03 11:30:23.803324 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6517902-8dcc-4a3f-bc63-2bfd48358515 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e20e10e5-b0bc-4275-ac5b-0ff1648bbd76,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:23.821470 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-9e9eaaa3-e5f2-43fe-8fde-bc05ebbe4885 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:23.822931 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-9e9eaaa3-e5f2-43fe-8fde-bc05ebbe4885 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 809 time: 0.2503519 Sep 03 11:30:23.836010 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-52865403-5327-41dd-a7e4-b664fea4df7e service neutron] 10.222.0.11 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966647 Sep 03 11:30:23.938701 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f7000a32-aed7-401d-8575-3a956bbb5eb8 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:30:23.972881 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59498) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:23.979715 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-40167a04-ef9b-4669-b263-0a98b029dc06 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 380 time: 0.1367679 Sep 03 11:30:23.992277 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'port': {'device_id': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'admin_state_up': True, 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'security_groups': ['726fd293-a4b6-41bd-86f0-08e2e13f4a9f']}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:24.008278 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a80fa6f3-ad98-4138-b0ef-fc94bea3d425 req-49aa8aba-1738-45ee-98b5-b3a99ca787ce service neutron] 10.222.0.11 "GET /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1642087 Sep 03 11:30:24.066897 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.119459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:24.125115 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-4f94a998-3f9c-4e00-ab31-2a3b79f937ed service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3184676 Sep 03 11:30:24.133020 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'f7000a32-aed7-401d-8575-3a956bbb5eb8', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'port_id': 'f7000a32-aed7-401d-8575-3a956bbb5eb8', 'mac_address': 'fa:16:3e:1f:0c:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c64b6662-4e29-47d5-96b7-4719ce1edb33', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:30:24.137220 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-833000e6-9e86-4902-9c3c-e1750561c3c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.191990 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.230954 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f7000a32-aed7-401d-8575-3a956bbb5eb8 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:24.256742 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:24.288277 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-833000e6-9e86-4902-9c3c-e1750561c3c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.301754 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a0ab37-28f7-42f5-9017-c06ae60b93f7 req-852ab1a1-7a6c-49ef-9604-6ba2dad031ce tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:24.303316 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c0a0ab37-28f7-42f5-9017-c06ae60b93f7 req-852ab1a1-7a6c-49ef-9604-6ba2dad031ce tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 943 time: 0.0771246 Sep 03 11:30:24.326342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.328658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.329423 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1787e601-3fc1-4b10-b40f-019d14b569a6 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:30:24.357708 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-833000e6-9e86-4902-9c3c-e1750561c3c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.385456 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c0a0ab37-28f7-42f5-9017-c06ae60b93f7 req-b21f277f-7569-4a92-bdfd-2b9d6babf23b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705419 Sep 03 11:30:24.412179 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:24.412396 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-833000e6-9e86-4902-9c3c-e1750561c3c0 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=568e985b38cf4e8d9fdc003a832be6a0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4386148 Sep 03 11:30:24.418471 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59512) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:24.422264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-833000e6-9e86-4902-9c3c-e1750561c3c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d932149-883c-4532-9c2f-5ffa1bc421db,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:24.499722 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1022cf0-ef91-47d8-8fce-f8011bbeebdc req-3b2740cf-d645-4c2e-b70f-adef93912cd0 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3561921 Sep 03 11:30:24.534081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.546948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1787e601-3fc1-4b10-b40f-019d14b569a6,segment=NetworkSegment(8483a2f2-1768-46a2-b6ca-7df7e3ec18b3),segment_id=8483a2f2-1768-46a2-b6ca-7df7e3ec18b3)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:24.550676 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Made reservation on behalf of 8e0bcf21f2dd49fe9f29d6892da5d5cc for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:24.555085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.563199 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.567700 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '1787e601-3fc1-4b10-b40f-019d14b569a6', 'network_id': 'e4ae560a-b704-4763-8338-c0b652784a4f', 'port_id': '1787e601-3fc1-4b10-b40f-019d14b569a6', 'mac_address': 'fa:16:3e:92:f1:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c707ad6-c2c1-4d5a-a165-571e0df41796', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:30:24.573238 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.576160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.577523 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e20e10e5-b0bc-4275-ac5b-0ff1648bbd76 HTTP/1.1" status: 204 len: 168 time: 0.7811248 Sep 03 11:30:24.591993 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6990ee-7752-4eca-85f5-4494e60e5d99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e20e10e5-b0bc-4275-ac5b-0ff1648bbd76,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:24.605937 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d42bf7fa-1ed6-43e8-b34b-7b44cbef88ec req-f4a40a3a-3336-4474-9721-2e3ea7cb3239 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0441217 Sep 03 11:30:24.631503 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.651843 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1787e601-3fc1-4b10-b40f-019d14b569a6 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:24.673684 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1787e601-3fc1-4b10-b40f-019d14b569a6,segment=NetworkSegment(8483a2f2-1768-46a2-b6ca-7df7e3ec18b3),segment_id=8483a2f2-1768-46a2-b6ca-7df7e3ec18b3)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:24.728053 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.745987 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.748126 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.748939 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Allocated IP 172.20.0.10 (246bd34f-94aa-4eae-85ba-a0f3e2f663ce/d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a/762cbd9c-2049-467b-9943-50cbaeca9799) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:30:24.752060 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7d932149-883c-4532-9c2f-5ffa1bc421db HTTP/1.1" status: 204 len: 168 time: 0.3321712 Sep 03 11:30:24.765373 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627fae31-d77f-4a59-9687-1e90e5855d7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d932149-883c-4532-9c2f-5ffa1bc421db,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:24.836905 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:24.864486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8115d1f6-ea0b-4145-ac5f-581b6d87bc36 req-2340375d-ba73-45f0-8f70-21400428d535 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:24.866053 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8115d1f6-ea0b-4145-ac5f-581b6d87bc36 req-2340375d-ba73-45f0-8f70-21400428d535 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 944 time: 0.0783515 Sep 03 11:30:24.919686 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8115d1f6-ea0b-4145-ac5f-581b6d87bc36 req-857d9463-62a1-4686-bb6c-83ebd74f9b5b tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458686 Sep 03 11:30:24.939605 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:24.954678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Transition to ACTIVE for port object 762cbd9c-2049-467b-9943-50cbaeca9799 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:25.087919 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.130234 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:30:25.134600 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:25.137120 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:30:25.143296 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:25.143484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.170618 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:25.248613 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2b0339ef-2785-4d68-a96f-ed7cf4c178b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2627721 Sep 03 11:30:25.488323 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-0df5f511-1487-42bc-bd29-b27dd542172d None None] Provisioning for port 762cbd9c-2049-467b-9943-50cbaeca9799 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:25.495408 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-0df5f511-1487-42bc-bd29-b27dd542172d None None] Provisioning complete for port 762cbd9c-2049-467b-9943-50cbaeca9799 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:25.496292 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0df5f511-1487-42bc-bd29-b27dd542172d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.513537 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e4475d-7d51-4d09-8c65-97b040013c50 req-163c05e5-b66b-4fc0-b715-a49d784cebc2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:25.521569 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d6e4475d-7d51-4d09-8c65-97b040013c50 req-163c05e5-b66b-4fc0-b715-a49d784cebc2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 944 time: 0.0637465 Sep 03 11:30:25.537122 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-0df5f511-1487-42bc-bd29-b27dd542172d None None] Port 762cbd9c-2049-467b-9943-50cbaeca9799 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:30:25.553564 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59570) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:25.571541 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d6e4475d-7d51-4d09-8c65-97b040013c50 req-19c9001d-bf3d-4eb4-8091-27bb18090980 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490694 Sep 03 11:30:25.572678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f027c1-11a0-4746-a4b9-c74353e36934 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.635915 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59574) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:25.673722 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f027c1-11a0-4746-a4b9-c74353e36934 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.730707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1cb9cb-5f76-4571-954e-e22c511d6994 req-fdc9a4cb-0d96-4a7b-b942-56da80e4bcf6 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:25.732256 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bd1cb9cb-5f76-4571-954e-e22c511d6994 req-fdc9a4cb-0d96-4a7b-b942-56da80e4bcf6 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 932 time: 0.0514216 Sep 03 11:30:25.733336 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b1f027c1-11a0-4746-a4b9-c74353e36934 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.788792 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f027c1-11a0-4746-a4b9-c74353e36934 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e1f7c15-0d7b-4ba9-a36c-3be6fb12bb55,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:25.792923 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b1f027c1-11a0-4746-a4b9-c74353e36934 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=964b9467ff4748c89b6d852acfc39b8c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2397559 Sep 03 11:30:25.795608 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2984-d6f7-4c6e-a952-60a297b9c00b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.796510 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59580) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:25.827019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bd1cb9cb-5f76-4571-954e-e22c511d6994 req-4c525954-43fa-42d5-a384-bc8fc7ced63b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0879028 Sep 03 11:30:25.867646 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.900617 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.909114 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2984-d6f7-4c6e-a952-60a297b9c00b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:25.975431 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59590) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:26.013166 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0e5d2984-d6f7-4c6e-a952-60a297b9c00b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.047557 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c245fb20-2065-4468-972b-b5074497bebf req-5a4aad78-846e-488a-8369-3ebb0eb4eed2 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:26.049305 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c245fb20-2065-4468-972b-b5074497bebf req-5a4aad78-846e-488a-8369-3ebb0eb4eed2 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 944 time: 0.0563598 Sep 03 11:30:26.051874 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.054997 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.056109 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3e1f7c15-0d7b-4ba9-a36c-3be6fb12bb55 HTTP/1.1" status: 204 len: 168 time: 0.2587616 Sep 03 11:30:26.060180 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-0e5d2984-d6f7-4c6e-a952-60a297b9c00b admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a936ed47662e4e319805cf784b7c1924&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4201722 Sep 03 11:30:26.060180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5d2984-d6f7-4c6e-a952-60a297b9c00b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a52f175-923e-4faa-9583-28007f72489b,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:26.060958 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59596) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:26.076548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15554a3f-bfac-45fc-84db-da795904dd4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e1f7c15-0d7b-4ba9-a36c-3be6fb12bb55,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:26.121273 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.132414 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c245fb20-2065-4468-972b-b5074497bebf req-e385126c-ef69-4520-92b0-cf7c54b89beb tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710967 Sep 03 11:30:26.149527 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.178978 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c33394ba-fa59-4584-a385-e95a4d5a4e3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.333391 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.333578 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-60d4e98d-0ab0-4d09-b97b-969ec41be700 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.337402 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.344675 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6a52f175-923e-4faa-9583-28007f72489b HTTP/1.1" status: 204 len: 168 time: 0.2749851 Sep 03 11:30:26.346347 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558497bf-ecfd-40f2-8fed-fff6d4e5bea5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a52f175-923e-4faa-9583-28007f72489b,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:26.401118 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c33394ba-fa59-4584-a385-e95a4d5a4e3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.476178 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c33394ba-fa59-4584-a385-e95a4d5a4e3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.526430 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c33394ba-fa59-4584-a385-e95a4d5a4e3c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=4ebe68b882544c11a93c9dcaa4f898da&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5471873 Sep 03 11:30:26.526430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33394ba-fa59-4584-a385-e95a4d5a4e3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c90acb3-5a9d-4670-a352-d7bee21e4d89,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:26.527316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59608) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:26.584266 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.606776 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.694939 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.710770 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.717061 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:30:26.717250 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.717795 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1c90acb3-5a9d-4670-a352-d7bee21e4d89 HTTP/1.1" status: 204 len: 168 time: 0.1898725 Sep 03 11:30:26.725852 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Request body: {'port': {'device_id': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:26.730836 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987b01ae-a40c-4f7c-8f7a-155fac3b9208 req-d93b758a-dc9c-4abd-afd4-12e7f9fb73a3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:26.732832 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-987b01ae-a40c-4f7c-8f7a-155fac3b9208 req-d93b758a-dc9c-4abd-afd4-12e7f9fb73a3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 944 time: 0.0695505 Sep 03 11:30:26.801820 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:26.815324 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-987b01ae-a40c-4f7c-8f7a-155fac3b9208 req-11f939f7-d1e1-48a7-bfcf-85dd87d3018b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757253 Sep 03 11:30:26.826600 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eedb73cc-b41c-4ef9-afec-7598cce35648 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c90acb3-5a9d-4670-a352-d7bee21e4d89,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:26.980184 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe0a6c3-1542-4c37-b803-a2c7c0028b5e req-7cb46e3c-827a-4a97-bd7f-e41a79e845be tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:26.981775 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5fe0a6c3-1542-4c37-b803-a2c7c0028b5e req-7cb46e3c-827a-4a97-bd7f-e41a79e845be tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 932 time: 0.0684333 Sep 03 11:30:27.027802 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5fe0a6c3-1542-4c37-b803-a2c7c0028b5e req-033cc859-a9fe-42e1-a8af-6c9ab65501dc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381262 Sep 03 11:30:27.142881 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 762cbd9c-2049-467b-9943-50cbaeca9799 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:27.151816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.166662 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Transition to ACTIVE for port object 762cbd9c-2049-467b-9943-50cbaeca9799 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:30:27.247526 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.248978 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06fcd41a-0766-4111-a145-b0a658714183 req-c4dddf92-3a39-46d4-b87e-9231123cbfd8 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:27.250483 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06fcd41a-0766-4111-a145-b0a658714183 req-c4dddf92-3a39-46d4-b87e-9231123cbfd8 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 944 time: 0.0483055 Sep 03 11:30:27.305027 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06fcd41a-0766-4111-a145-b0a658714183 req-3e60c3c1-688a-4037-a6f7-15b7053a445a tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469842 Sep 03 11:30:27.308658 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Pushing event updated for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:27.348735 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Attempting to bind port 762cbd9c-2049-467b-9943-50cbaeca9799 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:30:27.351065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Attempting to bind port 762cbd9c-2049-467b-9943-50cbaeca9799 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:30:27.351065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Attempting to bind port 762cbd9c-2049-467b-9943-50cbaeca9799 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:27.357423 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Port 762cbd9c-2049-467b-9943-50cbaeca9799 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:30:27.357746 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Attempting to bind port 762cbd9c-2049-467b-9943-50cbaeca9799 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:30:27.363246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 30, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:30:27.363958 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Checking segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:27.364061 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Bound using segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:30:27.364494 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Bound port: 762cbd9c-2049-467b-9943-50cbaeca9799, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:30:27.364856 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.418475 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59638) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:27.436245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e19f09a5-8734-4753-8080-700fbaab403d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.436533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:30:27.440084 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=762cbd9c-2049-467b-9943-50cbaeca9799,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:30:27.522671 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.534615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e19f09a5-8734-4753-8080-700fbaab403d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.560119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:27.562533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.562533 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] 10.222.0.11 "PUT /v2.0/ports/762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 1094 time: 0.8430865 Sep 03 11:30:27.562533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:27.564686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6883865a-7f00-429d-93c1-49a4d0d60427" -d '{"events": [{"name": "network-changed", "server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:27.598169 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f96e779-bc1a-458d-9ffd-cfa8863344d5 service neutron] Pushing event updated for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:27.603316 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.603789 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e19f09a5-8734-4753-8080-700fbaab403d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.622612 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d25ae7d-5e1d-4885-b0e2-6590d03d16e5 x-openstack-request-id: req-2d25ae7d-5e1d-4885-b0e2-6590d03d16e5 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:27.622950 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:27.623200 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2d25ae7d-5e1d-4885-b0e2-6590d03d16e5 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:27.623835 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799', 'status': 'completed', 'code': 200} Sep 03 11:30:27.650175 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e19f09a5-8734-4753-8080-700fbaab403d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=77776d8fd1c44b088276c05bf240855c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2282038 Sep 03 11:30:27.650175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19f09a5-8734-4753-8080-700fbaab403d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2eeffa2e-971d-4296-ae98-c4bb8207eadc,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:27.651019 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 59644) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:27.698815 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['1787e601-3fc1-4b10-b40f-019d14b569a6'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:30:27.706216 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59648) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:27.741198 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0f962669-a2c6-445f-81e9-b71eb4c89aec admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.825349 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.870350 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.901888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-033059a2-dd34-4ad9-bccd-c8ee9a753a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:27.904062 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-033059a2-dd34-4ad9-bccd-c8ee9a753a72 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1097 time: 0.2101243 Sep 03 11:30:27.942746 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0f962669-a2c6-445f-81e9-b71eb4c89aec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:27.967864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478d3899-b1b3-4f02-9e0b-0f2b1637edd1 req-c235b509-4c45-4e92-a3b4-ec7450da1e01 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:27.969379 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-478d3899-b1b3-4f02-9e0b-0f2b1637edd1 req-c235b509-4c45-4e92-a3b4-ec7450da1e01 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 944 time: 0.0603735 Sep 03 11:30:28.013218 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-478d3899-b1b3-4f02-9e0b-0f2b1637edd1 req-0d1c068e-3446-4e4f-83d7-aafb66e5087d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365586 Sep 03 11:30:28.083999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0f962669-a2c6-445f-81e9-b71eb4c89aec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.118935 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-8257ce93-3f00-427b-98f3-46902313b3a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.122470 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-8257ce93-3f00-427b-98f3-46902313b3a4 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&shared=False HTTP/1.1" status: 200 len: 910 time: 0.2095871 Sep 03 11:30:28.160105 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f962669-a2c6-445f-81e9-b71eb4c89aec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69258857-7d44-4731-b94e-cbf00c5fb572,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:28.189883 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-0f962669-a2c6-445f-81e9-b71eb4c89aec admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3b236d39d3d24e9aa29f6368635084a0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4823499 Sep 03 11:30:28.208173 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 59660) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:28.213733 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.229608 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.229608 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2eeffa2e-971d-4296-ae98-c4bb8207eadc HTTP/1.1" status: 204 len: 168 time: 0.5737216 Sep 03 11:30:28.262010 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fcb19b-73b9-427a-b74d-33a7b565b222 req-a319541c-50d3-4df6-8b07-6dee5b1e8388 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.264159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-59fcb19b-73b9-427a-b74d-33a7b565b222 req-a319541c-50d3-4df6-8b07-6dee5b1e8388 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 944 time: 0.0982685 Sep 03 11:30:28.285867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425bcce5-f07d-4b86-a0c2-0662e242cb25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2eeffa2e-971d-4296-ae98-c4bb8207eadc,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:28.354672 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-59fcb19b-73b9-427a-b74d-33a7b565b222 req-81609cf0-24d3-4e7b-9823-130da6a8ddb8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0758908 Sep 03 11:30:28.358904 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.383300 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.405685 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-f9846653-85a4-461f-9412-2c11fdc66ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.407686 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6883865a-7f00-429d-93c1-49a4d0d60427 req-f9846653-85a4-461f-9412-2c11fdc66ca1 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2782571 Sep 03 11:30:28.477240 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ac84cb-b410-426f-baa0-90812cda84c5 req-c3de600b-3fb4-476b-a9d4-4a02f629d3a0 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.484575 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-97ac84cb-b410-426f-baa0-90812cda84c5 req-c3de600b-3fb4-476b-a9d4-4a02f629d3a0 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 944 time: 0.0828855 Sep 03 11:30:28.492467 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-c76bdf07-d9a1-4190-9970-47998f0d934e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.495919 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-c76bdf07-d9a1-4190-9970-47998f0d934e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1097 time: 0.0474601 Sep 03 11:30:28.532888 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-97ac84cb-b410-426f-baa0-90812cda84c5 req-25c877fd-de94-4ac7-a37a-f7e73e2874d5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425742 Sep 03 11:30:28.542472 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-2c1b89b1-5a24-453a-857f-4aebc76266a7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 217 time: 0.0375986 Sep 03 11:30:28.602194 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.605179 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.607086 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/69258857-7d44-4731-b94e-cbf00c5fb572 HTTP/1.1" status: 204 len: 168 time: 0.3958945 Sep 03 11:30:28.611828 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-33c37229-1699-4c25-bbda-30cda4ebe978 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.613417 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-33c37229-1699-4c25-bbda-30cda4ebe978 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0637856 Sep 03 11:30:28.615422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baaafb6c-45bc-4d22-9c81-6db3d10096fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69258857-7d44-4731-b94e-cbf00c5fb572,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:28.677262 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-b39fd045-858e-47fb-994c-54df00a36b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:28.678907 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-b39fd045-858e-47fb-994c-54df00a36b67 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0569990 Sep 03 11:30:28.713618 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f7000a32-aed7-401d-8575-3a956bbb5eb8 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:28.794054 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-5a7cd0c8-3969-439c-a2d2-d21312bd9cbb service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070549 Sep 03 11:30:28.881965 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port f7000a32-aed7-401d-8575-3a956bbb5eb8 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:28.885956 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port f7000a32-aed7-401d-8575-3a956bbb5eb8 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:28.886487 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:28.897728 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f815d0a3-e033-4ca6-a11f-86449d0f8de4 req-40c9b4b0-6ecf-4ce8-93c0-78769fcfde56 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0957596 Sep 03 11:30:28.942234 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:30:29.000811 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:29.037401 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:29.124781 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:29.136299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:29.227348 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f13a73-c833-47b4-b187-caed9fe3a0f6 req-e8b38311-386e-4b80-9480-c3f240e979f2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:29.229417 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6f13a73-c833-47b4-b187-caed9fe3a0f6 req-e8b38311-386e-4b80-9480-c3f240e979f2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 944 time: 0.0745950 Sep 03 11:30:29.281711 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6f13a73-c833-47b4-b187-caed9fe3a0f6 req-7a96b46c-6b47-4371-b4dd-e6b8a8abd231 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460458 Sep 03 11:30:29.344590 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:29.345405 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1787e601-3fc1-4b10-b40f-019d14b569a6 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:29.467714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:29.575216 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b46809-848a-40d6-b2c7-2e7ebb7d7e71 req-f8882e78-3bf4-445f-97e0-7c4b6f8c3b44 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:29.588341 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79b46809-848a-40d6-b2c7-2e7ebb7d7e71 req-f8882e78-3bf4-445f-97e0-7c4b6f8c3b44 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 944 time: 0.0760756 Sep 03 11:30:29.665806 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79b46809-848a-40d6-b2c7-2e7ebb7d7e71 req-5ba569a0-5f7f-4fed-acbc-aecedc14b292 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0762444 Sep 03 11:30:29.670253 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 1787e601-3fc1-4b10-b40f-019d14b569a6 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:29.678930 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 1787e601-3fc1-4b10-b40f-019d14b569a6 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:29.679304 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:29.740584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1274642-696d-4319-ad67-d681e3a87fd6 req-81cdeab8-d8be-4372-84bb-9a760a5fab76 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:29.742853 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f1274642-696d-4319-ad67-d681e3a87fd6 req-81cdeab8-d8be-4372-84bb-9a760a5fab76 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 944 time: 0.0743916 Sep 03 11:30:29.766028 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cff0928d-0230-4b9e-9a8a-fb875239acd3" -d '{"events": [{"server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "name": "network-vif-plugged", "status": "completed", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:29.819329 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f1274642-696d-4319-ad67-d681e3a87fd6 req-11ed2931-22f5-42ee-b1d3-eedb1a7276a9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626583 Sep 03 11:30:29.870228 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:29.928822 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1787e601-3fc1-4b10-b40f-019d14b569a6,segment=NetworkSegment(8483a2f2-1768-46a2-b6ca-7df7e3ec18b3),segment_id=8483a2f2-1768-46a2-b6ca-7df7e3ec18b3)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:30.031032 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:30.114086 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:30.172090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8a0b15e-8455-480a-973b-478e03e5dd2b x-openstack-request-id: req-a8a0b15e-8455-480a-973b-478e03e5dd2b {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:30.176891 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "name": "network-vif-plugged", "status": "completed", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:30.177478 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a8a0b15e-8455-480a-973b-478e03e5dd2b {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:30.180859 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8', 'code': 200} Sep 03 11:30:30.466541 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f7023f6-7559-4042-a8ea-191ad3015a94 req-8d9e6871-af87-4c23-ac4d-52022f09b4b1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:30.476580 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6f7023f6-7559-4042-a8ea-191ad3015a94 req-8d9e6871-af87-4c23-ac4d-52022f09b4b1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0745542 Sep 03 11:30:30.558409 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6f7023f6-7559-4042-a8ea-191ad3015a94 req-a4940fce-b21a-4f05-bb8f-0c5eae437c49 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822017 Sep 03 11:30:30.673198 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-30606156-fccb-439d-b99a-252a3c0f691c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:30.675729 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-30606156-fccb-439d-b99a-252a3c0f691c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 1098 time: 0.1664338 Sep 03 11:30:30.697647 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-c7661eda-0447-4dd6-81ed-74364aaf96e3 service neutron] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:30.721202 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 762cbd9c-2049-467b-9943-50cbaeca9799 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:30:30.857661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b091d3-14a5-4382-bca5-bd3f1316d743 req-689be70e-538e-4295-8ab2-5d3e7249b186 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:30.871267 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-63b091d3-14a5-4382-bca5-bd3f1316d743 req-689be70e-538e-4295-8ab2-5d3e7249b186 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 944 time: 0.1056030 Sep 03 11:30:30.898215 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-c7661eda-0447-4dd6-81ed-74364aaf96e3 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:30.907131 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=762cbd9c-2049-467b-9943-50cbaeca9799,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:30.934157 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '762cbd9c-2049-467b-9943-50cbaeca9799', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'port_id': '762cbd9c-2049-467b-9943-50cbaeca9799', 'mac_address': 'fa:16:3e:49:38:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:30:30.944422 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-63b091d3-14a5-4382-bca5-bd3f1316d743 req-dc3d24b2-2520-41c4-992e-322fc92d7f5d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697885 Sep 03 11:30:30.957805 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-c7661eda-0447-4dd6-81ed-74364aaf96e3 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:31.005041 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d75c1c4d-5679-4c8c-8105-5a9931ffbd68 req-c7661eda-0447-4dd6-81ed-74364aaf96e3 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3201208 Sep 03 11:30:31.053692 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7661eda-0447-4dd6-81ed-74364aaf96e3 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=a6a10808-482d-4fb5-930b-17996ac9383b,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:31.069393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ca586f-34e1-429f-ad72-e37ac528aede req-1299f7fe-a218-4cd7-be38-dc92d4b31304 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:31.076037 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:31.076185 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30ca586f-34e1-429f-ad72-e37ac528aede req-1299f7fe-a218-4cd7-be38-dc92d4b31304 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.1189389 Sep 03 11:30:31.090128 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 762cbd9c-2049-467b-9943-50cbaeca9799 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:30:31.131407 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30ca586f-34e1-429f-ad72-e37ac528aede req-0da9ad1d-0677-48cc-8c3b-fcf0e89d6701 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489137 Sep 03 11:30:31.140938 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=762cbd9c-2049-467b-9943-50cbaeca9799,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:31.217195 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:31.286714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:31.454729 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['762cbd9c-2049-467b-9943-50cbaeca9799'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:30:31.725069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce662544-4f56-4caa-86d6-b5f7ad164add req-9d2ea398-850a-4c81-85c0-019845c6269e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:31.735779 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ce662544-4f56-4caa-86d6-b5f7ad164add req-9d2ea398-850a-4c81-85c0-019845c6269e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0707896 Sep 03 11:30:31.793505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ce662544-4f56-4caa-86d6-b5f7ad164add req-7002b865-eab8-474b-8e0d-f7e43e56eef8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533986 Sep 03 11:30:32.093190 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9855b7cd-a329-4973-9b1d-d445bb42acb8 req-084468aa-370e-4e6a-8b9b-1b1ea43fe356 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:32.094955 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9855b7cd-a329-4973-9b1d-d445bb42acb8 req-084468aa-370e-4e6a-8b9b-1b1ea43fe356 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 945 time: 0.0523522 Sep 03 11:30:32.138710 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9855b7cd-a329-4973-9b1d-d445bb42acb8 req-ecfecf1f-2aed-4659-9498-3346c4b16c4a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359581 Sep 03 11:30:32.182217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:32.186805 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f3292f9-dd19-41b3-90eb-881d3b1ab24a" -d '{"events": [{"server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "name": "network-vif-plugged", "status": "completed", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:32.260047 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3d6b8bb-f608-4c87-95d0-26b0f044b045 x-openstack-request-id: req-e3d6b8bb-f608-4c87-95d0-26b0f044b045 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:32.261189 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "name": "network-vif-plugged", "status": "completed", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:32.261189 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e3d6b8bb-f608-4c87-95d0-26b0f044b045 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:32.261751 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6', 'code': 200} Sep 03 11:30:32.302772 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eede6bfe-52c6-45ef-b374-c6f7aa9ca9ae req-9325b4e0-de01-46c3-a281-e1c512bec3a9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:32.314016 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eede6bfe-52c6-45ef-b374-c6f7aa9ca9ae req-9325b4e0-de01-46c3-a281-e1c512bec3a9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0995266 Sep 03 11:30:32.365867 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eede6bfe-52c6-45ef-b374-c6f7aa9ca9ae req-5e8bb24c-c61c-4d65-a909-6530f4f1ab31 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508530 Sep 03 11:30:32.698520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c01953-dc42-4ba4-a364-1db544e512fd req-4685b7c8-8955-4531-a26a-92cafcfc4cd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:32.703454 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-e2c01953-dc42-4ba4-a364-1db544e512fd req-4685b7c8-8955-4531-a26a-92cafcfc4cd3 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 1098 time: 0.0504575 Sep 03 11:30:32.740736 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 762cbd9c-2049-467b-9943-50cbaeca9799 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:30:32.772418 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-e2c01953-dc42-4ba4-a364-1db544e512fd req-02d1afd1-2315-408d-9d00-b3a42dd472eb service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643606 Sep 03 11:30:32.930945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 762cbd9c-2049-467b-9943-50cbaeca9799 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:30:32.933557 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 762cbd9c-2049-467b-9943-50cbaeca9799 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:30:32.934115 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:32.947660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc46a3b-d366-421b-801f-e6c63b09866e req-83cc9ca6-5576-431f-b156-175a8c236e34 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:32.949212 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0cc46a3b-d366-421b-801f-e6c63b09866e req-83cc9ca6-5576-431f-b156-175a8c236e34 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0607662 Sep 03 11:30:33.011105 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0cc46a3b-d366-421b-801f-e6c63b09866e req-ef99497a-0c2e-48b5-bf6a-e2f390a1cec6 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424213 Sep 03 11:30:33.018492 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:33.057603 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=762cbd9c-2049-467b-9943-50cbaeca9799,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:30:33.162654 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:33.328635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34461fba-d7a5-418c-932c-d5181e8b1c38 req-bb57b4e4-7420-4474-bd65-c910f4a9bee4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:33.330253 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34461fba-d7a5-418c-932c-d5181e8b1c38 req-bb57b4e4-7420-4474-bd65-c910f4a9bee4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0719995 Sep 03 11:30:33.358724 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:33.375849 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34461fba-d7a5-418c-932c-d5181e8b1c38 req-9daa2591-59db-4fd3-8462-8a2cbf7acac8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376318 Sep 03 11:30:33.497375 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c59cec91-c54d-4995-95af-55d923fd7aa6 req-a926ee26-dfd2-498c-a9a8-0e42aefee171 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:33.499112 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c59cec91-c54d-4995-95af-55d923fd7aa6 req-a926ee26-dfd2-498c-a9a8-0e42aefee171 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0570712 Sep 03 11:30:33.541631 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c59cec91-c54d-4995-95af-55d923fd7aa6 req-bb8e7f21-3b63-4854-bc03-c36c1b86b366 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357738 Sep 03 11:30:34.135628 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0541116-660a-4c1f-b5ca-728d32decfb8 req-16ccc643-dd3e-462b-ba21-95e51437713a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:34.137143 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0541116-660a-4c1f-b5ca-728d32decfb8 req-16ccc643-dd3e-462b-ba21-95e51437713a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0538664 Sep 03 11:30:34.181051 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0541116-660a-4c1f-b5ca-728d32decfb8 req-47276c56-ff71-4b0c-9c07-b9508a8778db tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380380 Sep 03 11:30:34.263002 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:34.265417 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f361d39b-35f9-4f01-9333-aab9f042295e" -d '{"events": [{"server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "name": "network-vif-plugged", "status": "completed", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:34.304800 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d409e139-22e3-4af9-871f-0768687a7462 x-openstack-request-id: req-d409e139-22e3-4af9-871f-0768687a7462 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:34.305085 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "name": "network-vif-plugged", "status": "completed", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:34.305331 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-d409e139-22e3-4af9-871f-0768687a7462 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:34.305711 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799', 'code': 200} Sep 03 11:30:34.508223 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aeb93f7-a729-403b-aff7-c6521eeebbb3 req-b898adc2-d820-43b2-a8cd-ea23639d9874 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:34.509695 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1aeb93f7-a729-403b-aff7-c6521eeebbb3 req-b898adc2-d820-43b2-a8cd-ea23639d9874 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0546949 Sep 03 11:30:34.550832 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1aeb93f7-a729-403b-aff7-c6521eeebbb3 req-f4d6317b-3c5d-4acb-9a7b-efb2c8049e9b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330575 Sep 03 11:30:34.669027 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1889f7d6-3425-4f18-b55b-312c249b484f req-d5e9ce88-fde4-4240-9e62-c6987f52e520 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:34.674396 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1889f7d6-3425-4f18-b55b-312c249b484f req-d5e9ce88-fde4-4240-9e62-c6987f52e520 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0527492 Sep 03 11:30:34.713857 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1889f7d6-3425-4f18-b55b-312c249b484f req-72aa0e77-3995-4ba5-8edc-7e4c5eaeb442 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360777 Sep 03 11:30:35.676163 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8561a7-e1a4-4e74-a472-057d9e5498fb req-bd66a1df-ab26-48c9-b872-f8c2f5582c38 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:35.677695 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd8561a7-e1a4-4e74-a472-057d9e5498fb req-bd66a1df-ab26-48c9-b872-f8c2f5582c38 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0511618 Sep 03 11:30:35.719289 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd8561a7-e1a4-4e74-a472-057d9e5498fb req-0383a3d3-d9d5-4e7a-9ae8-f1f80c6e9bac tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345390 Sep 03 11:30:36.842658 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce675b49-54f5-45ff-8007-8784fe946ce8 req-f3ece057-d77f-4a15-998c-26f54fca34cb tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:36.844167 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ce675b49-54f5-45ff-8007-8784fe946ce8 req-f3ece057-d77f-4a15-998c-26f54fca34cb tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0543501 Sep 03 11:30:36.889863 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ce675b49-54f5-45ff-8007-8784fe946ce8 req-3464300c-f60b-4681-b672-74465dad892a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389478 Sep 03 11:30:37.105044 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc4f6e0-f3dc-41bc-bcb3-9eb553f0ca4e req-76fe00c9-10e9-4cef-93a9-7ab3943bb2b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:37.106464 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5fc4f6e0-f3dc-41bc-bcb3-9eb553f0ca4e req-76fe00c9-10e9-4cef-93a9-7ab3943bb2b2 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1099 time: 0.0429964 Sep 03 11:30:37.145075 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5fc4f6e0-f3dc-41bc-bcb3-9eb553f0ca4e req-6257e006-fa2c-442d-b5b1-2e3bd730f859 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0292385 Sep 03 11:30:38.008884 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c727e1f8-3e35-412d-a77d-63df086cc086 req-6d0b9653-0b16-4512-856c-545cae2fdcf4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:38.010447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c727e1f8-3e35-412d-a77d-63df086cc086 req-6d0b9653-0b16-4512-856c-545cae2fdcf4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0538657 Sep 03 11:30:38.058685 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c727e1f8-3e35-412d-a77d-63df086cc086 req-da474d89-ed79-42cd-a017-bffe70c8f5e7 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422008 Sep 03 11:30:39.179288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f9fd73-61e7-4c89-bc85-72183cd94ee9 req-4b1a481a-2c73-448c-864e-1dfb97ef96e5 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:39.180805 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72f9fd73-61e7-4c89-bc85-72183cd94ee9 req-4b1a481a-2c73-448c-864e-1dfb97ef96e5 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0535436 Sep 03 11:30:39.218635 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72f9fd73-61e7-4c89-bc85-72183cd94ee9 req-c76f8ec8-0ed2-43e5-b5ac-071b51d30b64 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319362 Sep 03 11:30:40.336569 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2b0a3c-9914-4d99-bdf1-53801787b306 req-c3a145fc-6a5c-4ee7-897e-169337b65068 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:40.338078 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2b0a3c-9914-4d99-bdf1-53801787b306 req-c3a145fc-6a5c-4ee7-897e-169337b65068 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0519640 Sep 03 11:30:40.377165 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2b0a3c-9914-4d99-bdf1-53801787b306 req-dd310ab8-5bf1-4ee7-81f2-c902b96761c9 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329022 Sep 03 11:30:41.298830 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:41.502022 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a406e5-30e6-4403-9b46-ca93f8a7d5d6 req-0bfcfe9b-eb3a-4043-afe0-7f51b0149021 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:41.504532 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-94a406e5-30e6-4403-9b46-ca93f8a7d5d6 req-0bfcfe9b-eb3a-4043-afe0-7f51b0149021 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0573928 Sep 03 11:30:41.548466 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-94a406e5-30e6-4403-9b46-ca93f8a7d5d6 req-e6ac785b-8859-411c-b74c-5f47131b2e1f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378814 Sep 03 11:30:41.704571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c03ab85-6f27-4a43-88a9-6038d36b0287 req-b732d9df-f0fb-4464-8b54-fca0c6acd952 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:41.706902 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1c03ab85-6f27-4a43-88a9-6038d36b0287 req-b732d9df-f0fb-4464-8b54-fca0c6acd952 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0511959 Sep 03 11:30:41.714471 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60076) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:41.719405 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'floatingip': {'port_id': '762cbd9c-2049-467b-9943-50cbaeca9799'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:41.807750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:42.555124 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:42.624473 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:42.720751 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Floating IP 3bb5d025-8935-423d-9482-8d36af0da92d associated. External IP: 172.27.0.120, port: 762cbd9c-2049-467b-9943-50cbaeca9799. Sep 03 11:30:42.932100 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:30:43.037068 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:30:43.041688 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:43.050638 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:30:43.060181 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:43.060780 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:30:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:43.070464 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-332d7fc0-fe1d-4751-b50d-b7c6d4b81922 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "PUT /v2.0/floatingips/3bb5d025-8935-423d-9482-8d36af0da92d HTTP/1.1" status: 200 len: 992 time: 1.3547544 Sep 03 11:30:43.071129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:30:43.073475 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7876cef0-ae7b-412c-bb70-473490e38ac9" -d '{"events": [{"name": "network-changed", "server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:30:43.240240 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:43.514700 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '3bb5d025-8935-423d-9482-8d36af0da92d', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.120', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': '762cbd9c-2049-467b-9943-50cbaeca9799', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:49:38:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:30:16Z', 'updated_at': '2021-09-03T11:30:42Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:43.542210 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:30:43.551307 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:30:43.551919 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:30:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:43.620846 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60128) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:43.655580 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:30:43.724076 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4772abe-1e2a-49ba-96ac-0baf6d51cf8c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:43.811452 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4772abe-1e2a-49ba-96ac-0baf6d51cf8c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:43.881418 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4772abe-1e2a-49ba-96ac-0baf6d51cf8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:43.885928 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '3bb5d025-8935-423d-9482-8d36af0da92d', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.120', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': '762cbd9c-2049-467b-9943-50cbaeca9799', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:49:38:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:30:16Z', 'updated_at': '2021-09-03T11:30:42Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:30:43.913283 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a4e021-9db3-412b-bc02-8aed69d490fe None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '3bb5d025-8935-423d-9482-8d36af0da92d', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.120', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': '762cbd9c-2049-467b-9943-50cbaeca9799', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 103, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:49:38:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:30:16Z', 'updated_at': '2021-09-03T11:30:42Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:30:43.923569 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d4772abe-1e2a-49ba-96ac-0baf6d51cf8c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3b89229961154ddca856ba5887144841&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3016274 Sep 03 11:30:43.924948 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4772abe-1e2a-49ba-96ac-0baf6d51cf8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f0aeb4d-e2af-4f99-9a39-79641ae88559,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:43.926274 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60132) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:43.980142 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.001814 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.093262 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.097622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.099530 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7f0aeb4d-e2af-4f99-9a39-79641ae88559 HTTP/1.1" status: 204 len: 168 time: 0.1722002 Sep 03 11:30:44.117005 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df36062-e8e9-4a9f-beb6-037d0b189585 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f0aeb4d-e2af-4f99-9a39-79641ae88559,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:44.146346 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd28aff5-3c54-408b-a8c2-39048de55c97 None None] New status for floating IP 3bb5d025-8935-423d-9482-8d36af0da92d: ACTIVE {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:30:44.683814 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60150) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:44.697119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf799ee2-0c94-4f7c-98c3-d35e426e55ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.781268 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf799ee2-0c94-4f7c-98c3-d35e426e55ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.861604 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:30:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15c5721f-a7df-402e-b48c-c99dbcee0f94 x-openstack-request-id: req-15c5721f-a7df-402e-b48c-c99dbcee0f94 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:30:44.862171 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:30:44.862171 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-15c5721f-a7df-402e-b48c-c99dbcee0f94 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:30:44.862618 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799', 'status': 'completed', 'code': 200} Sep 03 11:30:44.864585 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf799ee2-0c94-4f7c-98c3-d35e426e55ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.914502 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-bf799ee2-0c94-4f7c-98c3-d35e426e55ac admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7ff929907cfc450894660712c0c9ac81&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2295282 Sep 03 11:30:44.917388 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60152) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:44.929339 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf799ee2-0c94-4f7c-98c3-d35e426e55ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11e56d0f-3502-49ef-a1b1-72a7c1c4ec7f,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:44.952646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-e1e2015d-54dd-44cf-bfd0-888eb8f31079 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:44.954145 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-e1e2015d-54dd-44cf-bfd0-888eb8f31079 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1099 time: 0.0516257 Sep 03 11:30:44.975704 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:44.996947 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:45.049705 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-bc682d49-61b7-481e-90b5-cc2ff6e96ba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:45.050998 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-bc682d49-61b7-481e-90b5-cc2ff6e96ba1 service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.0888550 Sep 03 11:30:45.116099 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:45.118621 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:45.122153 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/11e56d0f-3502-49ef-a1b1-72a7c1c4ec7f HTTP/1.1" status: 204 len: 168 time: 0.2013137 Sep 03 11:30:45.136796 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ad3de9-dab0-4775-9a95-58e407d3ed81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11e56d0f-3502-49ef-a1b1-72a7c1c4ec7f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:45.379797 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-0cdd3b98-a9f9-4b4a-8023-6e35fe402827 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 1002 time: 0.2722554 Sep 03 11:30:45.444429 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-d9bfd556-a4d3-482d-af85-6b6573900166 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:45.445898 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-d9bfd556-a4d3-482d-af85-6b6573900166 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0471978 Sep 03 11:30:45.501757 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-795d953d-cacf-491f-bf97-b5f0a870caf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:45.503996 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-795d953d-cacf-491f-bf97-b5f0a870caf0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0439677 Sep 03 11:30:45.633884 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-4254c7db-5c41-4ec3-b617-baa9ca2d9dbe service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1157503 Sep 03 11:30:45.738987 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-7876cef0-ae7b-412c-bb70-473490e38ac9 req-d3c44412-8bc2-4c6e-8562-f7d453e0549d service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888729 Sep 03 11:30:46.269056 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60216) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:46.486295 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6d7d126e-be59-4fdf-9e0a-9e65572e4559 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:46.604133 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6d7d126e-be59-4fdf-9e0a-9e65572e4559 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:46.652976 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6d7d126e-be59-4fdf-9e0a-9e65572e4559 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:46.702545 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6d7d126e-be59-4fdf-9e0a-9e65572e4559 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f45f9e3d71254f3a844d3cc5ffd07683&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4322276 Sep 03 11:30:46.704796 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7d126e-be59-4fdf-9e0a-9e65572e4559 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=471a0cf3-e716-4293-9ed7-0c528831adb8,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:46.705165 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60250) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:46.755433 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:46.779071 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.017099 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.020115 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.024896 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/471a0cf3-e716-4293-9ed7-0c528831adb8 HTTP/1.1" status: 204 len: 168 time: 0.3147752 Sep 03 11:30:47.041262 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81d24c0-1d45-4394-a411-704a46280065 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=471a0cf3-e716-4293-9ed7-0c528831adb8,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:47.680547 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60312) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:47.695129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b7d1b335-c4bf-4857-8ab5-81030b3bb387 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.799945 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b7d1b335-c4bf-4857-8ab5-81030b3bb387 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.876111 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b7d1b335-c4bf-4857-8ab5-81030b3bb387 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.915433 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d1b335-c4bf-4857-8ab5-81030b3bb387 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8eaedc60-7e56-444f-9a5a-264c07f7acae,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:47.919764 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b7d1b335-c4bf-4857-8ab5-81030b3bb387 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8798f74acecf42df8820457543a8f4a8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2380302 Sep 03 11:30:47.922822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60328) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:47.971309 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:47.991822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:48.128033 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:48.130894 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:48.132029 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/8eaedc60-7e56-444f-9a5a-264c07f7acae HTTP/1.1" status: 204 len: 168 time: 0.2086384 Sep 03 11:30:48.139703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0ed1105-bda8-43df-90c8-ff852f02ae50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8eaedc60-7e56-444f-9a5a-264c07f7acae,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:48.814180 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60364) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:48.917046 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93cba2bf-adcb-4c4e-b5b2-d5230a1b80cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.004190 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93cba2bf-adcb-4c4e-b5b2-d5230a1b80cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.064685 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93cba2bf-adcb-4c4e-b5b2-d5230a1b80cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.109702 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-93cba2bf-adcb-4c4e-b5b2-d5230a1b80cd admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=abd2542f103547e98a3896c5ebe3257c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2945104 Sep 03 11:30:49.109702 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cba2bf-adcb-4c4e-b5b2-d5230a1b80cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc941869-325b-469e-b710-f9294501394b,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:49.110580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60376) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:49.168881 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.194417 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.303683 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.306445 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:49.307976 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fc941869-325b-469e-b710-f9294501394b HTTP/1.1" status: 204 len: 168 time: 0.1943510 Sep 03 11:30:49.319654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34e36ce-1ab0-4658-9e85-406e6a59487d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc941869-325b-469e-b710-f9294501394b,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:50.043181 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60414) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:50.056106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fe07b87a-0fa1-43b5-aea2-6724ed78060e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.144781 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fe07b87a-0fa1-43b5-aea2-6724ed78060e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.195657 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fe07b87a-0fa1-43b5-aea2-6724ed78060e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.234237 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-fe07b87a-0fa1-43b5-aea2-6724ed78060e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=d01836e32d2d42a7bbbb4c62d6af60a2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1899519 Sep 03 11:30:50.237018 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60418) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:50.238978 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe07b87a-0fa1-43b5-aea2-6724ed78060e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af6b0c14-c782-4eca-ae22-ebaf548c05fe,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:50.296402 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.317133 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.436268 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.438897 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:50.440160 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/af6b0c14-c782-4eca-ae22-ebaf548c05fe HTTP/1.1" status: 204 len: 168 time: 0.2014601 Sep 03 11:30:50.454983 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89ae1909-5207-4649-9305-e080b4612415 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af6b0c14-c782-4eca-ae22-ebaf548c05fe,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:51.551429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60482) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:51.648592 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-335022275-network', 'tenant_id': 'c35f426e843b4862bf0cdd55f67069d9'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:51.749680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Made reservation on behalf of c35f426e843b4862bf0cdd55f67069d9 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:51.752009 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:51.760922 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:51.845555 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.001621 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.027119 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] vlan segment allocate from pool success with {'vlan_id': 383, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:30:52.036034 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72c3ccbb-ec16-46b6-bc41-55f6cc47f55a,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:52.043474 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.043474 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Added segment b0a799c1-5360-4aac-b91f-38caac33a00c of type vlan for network 0865e185-e75b-4fae-a3f3-139bddc92396 Sep 03 11:30:52.085835 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.200697 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.201763 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:52.202432 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.260147 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] Pushing event updated for resources: {'Network': ['ID=0865e185-e75b-4fae-a3f3-139bddc92396,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:52.270624 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 0865e185-e75b-4fae-a3f3-139bddc92396 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:30:52.276634 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-155d920d-9434-44a1-8034-94356af067d4 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7239287 Sep 03 11:30:52.287249 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60494) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:52.287249 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Request body: {'subnet': {'network_id': '0865e185-e75b-4fae-a3f3-139bddc92396', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-335022275-subnet', 'tenant_id': 'c35f426e843b4862bf0cdd55f67069d9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:52.384255 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Made reservation on behalf of c35f426e843b4862bf0cdd55f67069d9 for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:52.386607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Notify callbacks [] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.646912 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.700804 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Pushing event updated for resources: {'Subnet': ['ID=62ebfcfd-f616-4f75-93fe-db32716b171a,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:52.718295 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Checking segment: {'id': 'b0a799c1-5360-4aac-b91f-38caac33a00c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 383, 'network_id': '0865e185-e75b-4fae-a3f3-139bddc92396'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:52.718678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Network hostable DHCP agents. Network: 0865e185-e75b-4fae-a3f3-139bddc92396, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:30:52.819004 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Network 0865e185-e75b-4fae-a3f3-139bddc92396 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:30:52.921379 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 0865e185-e75b-4fae-a3f3-139bddc92396) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:52.926125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:52.926773 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:52.931772 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-905c259a-4be7-445d-8490-5688402f4a69 None None] Network 0865e185-e75b-4fae-a3f3-139bddc92396 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:53.057679 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cecd9984-d596-4e8d-ab77-be0e10866ae8 None None] Network 0865e185-e75b-4fae-a3f3-139bddc92396 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:53.102873 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9d1ccdcb-240a-4c6d-88e8-e80367bd306d admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8133283 Sep 03 11:30:53.540166 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60558) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:53.664095 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8adb7570-ca06-41ab-96be-977dc967a4ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:53.715809 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-9757f007-4375-4d87-9f4b-c53256c41a92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:53.765558 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8adb7570-ca06-41ab-96be-977dc967a4ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:53.873999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8adb7570-ca06-41ab-96be-977dc967a4ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:53.912809 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8adb7570-ca06-41ab-96be-977dc967a4ff admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=94cf83d43c484b22800624250b979b6c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3707116 Sep 03 11:30:53.915093 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adb7570-ca06-41ab-96be-977dc967a4ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38630835-06e1-4cdd-9fa3-6bd1cf150ff9,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:53.915553 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60580) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:53.968540 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:53.991363 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.025110 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60586) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:54.030646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2092059031-network', 'tenant_id': 'ddab1c3ee3124d939f0a6fdc8ef30a6b'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:54.104393 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Made reservation on behalf of ddab1c3ee3124d939f0a6fdc8ef30a6b for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:54.104756 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.107066 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.107414 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.108560 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/38630835-06e1-4cdd-9fa3-6bd1cf150ff9 HTTP/1.1" status: 204 len: 168 time: 0.1913776 Sep 03 11:30:54.117483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1953f9a6-4cac-426d-b175-950a8cd820c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38630835-06e1-4cdd-9fa3-6bd1cf150ff9,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:54.120673 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.236936 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.298900 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.325438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] vlan segment allocate from pool success with {'vlan_id': 379, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:30:54.336192 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfbb6f51-9df1-4c44-8934-2defd377d10f,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:54.341415 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.341415 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Added segment afbc2ec9-97a0-427a-aa8b-220e0eb6a393 of type vlan for network 6b1cf043-ef05-4691-b186-cc507a0dc8d2 Sep 03 11:30:54.395369 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.515476 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.516642 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:54.517227 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.582934 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] Pushing event updated for resources: {'Network': ['ID=6b1cf043-ef05-4691-b186-cc507a0dc8d2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:54.601502 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 6b1cf043-ef05-4691-b186-cc507a0dc8d2 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:30:54.615181 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-960aa3c3-7f3a-478d-af5a-1acbf27dfe20 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5889142 Sep 03 11:30:54.618583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60614) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:54.623472 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Request body: {'subnet': {'network_id': '6b1cf043-ef05-4691-b186-cc507a0dc8d2', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2092059031-subnet', 'tenant_id': 'ddab1c3ee3124d939f0a6fdc8ef30a6b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:30:54.715749 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Made reservation on behalf of ddab1c3ee3124d939f0a6fdc8ef30a6b for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:30:54.718043 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.806850 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60622) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:54.821200 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54322dd5-c0d4-4d79-a2e4-9b31f6d793e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:54.917822 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54322dd5-c0d4-4d79-a2e4-9b31f6d793e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.019577 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54322dd5-c0d4-4d79-a2e4-9b31f6d793e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.019928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.062478 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-54322dd5-c0d4-4d79-a2e4-9b31f6d793e1 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=e5ff855493734cf084f64e2e94fb42ec&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2541447 Sep 03 11:30:55.063564 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54322dd5-c0d4-4d79-a2e4-9b31f6d793e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e935b8fe-bc40-49f4-b1c0-a262693ee1e9,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:55.066051 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60626) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:55.092757 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Pushing event updated for resources: {'Subnet': ['ID=45ffb1df-94f7-4d6b-8964-1960a7f4a7b6,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:55.117519 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.124839 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d171197-b5ff-4372-b725-b6dcdf1f7630 req-5c104e1c-94fe-421e-bed7-30b961e30703 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:55.126340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d171197-b5ff-4372-b725-b6dcdf1f7630 req-5c104e1c-94fe-421e-bed7-30b961e30703 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0847759 Sep 03 11:30:55.132186 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Checking segment: {'id': 'afbc2ec9-97a0-427a-aa8b-220e0eb6a393', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '6b1cf043-ef05-4691-b186-cc507a0dc8d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:30:55.132642 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Network hostable DHCP agents. Network: 6b1cf043-ef05-4691-b186-cc507a0dc8d2, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:30:55.139450 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.183226 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d171197-b5ff-4372-b725-b6dcdf1f7630 req-cf9f7bfd-2818-4780-a20e-06a71a7836f9 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473044 Sep 03 11:30:55.235640 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Network 6b1cf043-ef05-4691-b186-cc507a0dc8d2 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:30:55.252701 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.255934 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.257076 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e935b8fe-bc40-49f4-b1c0-a262693ee1e9 HTTP/1.1" status: 204 len: 168 time: 0.1898561 Sep 03 11:30:55.264719 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ef57eb-0938-4f11-b512-1710b633da41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e935b8fe-bc40-49f4-b1c0-a262693ee1e9,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:55.298451 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 6b1cf043-ef05-4691-b186-cc507a0dc8d2) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:30:55.303969 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:55.306152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:55.309709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dcb8105-08b8-4603-9f52-918b535c249a None None] Network 6b1cf043-ef05-4691-b186-cc507a0dc8d2 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:55.359252 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5d1571c7-4241-422b-876a-bbc1ea7ff206 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7311680 Sep 03 11:30:55.431370 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82cd4bbb-746a-4d06-998c-39c02cc2bcd9 None None] Network 6b1cf043-ef05-4691-b186-cc507a0dc8d2 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:30:56.079903 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60670) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:56.196109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-85030ac7-c43e-4387-8099-a967a665cbce admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.289563 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-85030ac7-c43e-4387-8099-a967a665cbce admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.343279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a04a718-4268-4cc2-b613-2a6c1289679f req-cdcaa54c-01df-4004-b35d-d4bacbe45312 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:56.344938 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a04a718-4268-4cc2-b613-2a6c1289679f req-cdcaa54c-01df-4004-b35d-d4bacbe45312 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0848131 Sep 03 11:30:56.356015 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-aeaca052-c306-4c05-8e78-1c10b0aebc02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.383947 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-85030ac7-c43e-4387-8099-a967a665cbce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.398991 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a04a718-4268-4cc2-b613-2a6c1289679f req-3582f712-21bd-4cf4-935e-045882558aae tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476010 Sep 03 11:30:56.431367 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85030ac7-c43e-4387-8099-a967a665cbce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32d85e60-d405-4397-b649-05c39ffe8a9c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:56.438655 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-85030ac7-c43e-4387-8099-a967a665cbce admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=640ace3e80554f8e802e64e450c1a356&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3552141 Sep 03 11:30:56.438812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60690) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:56.499934 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.522998 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.624484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.626934 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:56.631557 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/32d85e60-d405-4397-b649-05c39ffe8a9c HTTP/1.1" status: 204 len: 168 time: 0.1835382 Sep 03 11:30:56.639492 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb99faa-7993-416b-8be2-3375298286c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32d85e60-d405-4397-b649-05c39ffe8a9c,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:56.693303 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.516531 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30017b78-1614-44bf-91f3-37f6c6e93ed4 req-96292b7a-a835-4e75-bd07-13f09cfe2ad4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:57.518037 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30017b78-1614-44bf-91f3-37f6c6e93ed4 req-96292b7a-a835-4e75-bd07-13f09cfe2ad4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0496578 Sep 03 11:30:57.532371 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60728) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:57.547939 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.565692 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30017b78-1614-44bf-91f3-37f6c6e93ed4 req-199442db-92c8-48a2-881d-7e4979a7606d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405648 Sep 03 11:30:57.607122 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.637493 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.698460 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.734930 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1db019b4-6c5d-4f8b-8423-d7ffa56764ae,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:57.740207 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8c13422d8555401fa14f18cb10a54137&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2059386 Sep 03 11:30:57.742986 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60730) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:57.745017 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.745369 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.745708 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.746046 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.746420 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.746734 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.747060 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.747388 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.747714 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.748037 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.748362 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.748687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95d901fc-d71d-43fb-b7f1-303d7f4536dc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.793138 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.814292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.944891 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.947579 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:57.948804 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1db019b4-6c5d-4f8b-8423-d7ffa56764ae HTTP/1.1" status: 204 len: 168 time: 0.2047014 Sep 03 11:30:57.957965 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1db019b4-6c5d-4f8b-8423-d7ffa56764ae,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:57.965292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.965489 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.965961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.966183 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.966641 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.966984 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.967305 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.967611 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.967928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.968244 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.968556 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:57.968873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b526e1c-76c1-4ffb-8759-e2dcbeb5d668 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:30:58.624679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 60750) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:58.642592 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-19dbb65b-1f70-45b4-bec9-6b2ae3544aa9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:58.705771 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-515e16a8-1c93-4062-a5d4-a317b824c01d req-9e03b9c0-8d90-4470-a4d0-32eb681a11e5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:58.707844 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-515e16a8-1c93-4062-a5d4-a317b824c01d req-9e03b9c0-8d90-4470-a4d0-32eb681a11e5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0672047 Sep 03 11:30:58.763900 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-515e16a8-1c93-4062-a5d4-a317b824c01d req-973a05ad-963e-43ec-85cc-ee11c037fcb5 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495441 Sep 03 11:30:58.796877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-19dbb65b-1f70-45b4-bec9-6b2ae3544aa9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:58.875373 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-19dbb65b-1f70-45b4-bec9-6b2ae3544aa9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:58.914119 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-19dbb65b-1f70-45b4-bec9-6b2ae3544aa9 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=21198a00330d42d1b30ee76b8d70df02&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2883348 Sep 03 11:30:58.914962 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19dbb65b-1f70-45b4-bec9-6b2ae3544aa9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e0b853c-bbf9-4d9a-b717-6aa7b9446df7,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:58.916856 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 60752) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:30:58.968319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:58.993008 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:59.041136 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:59.109727 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:59.112393 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:30:59.113632 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9e0b853c-bbf9-4d9a-b717-6aa7b9446df7 HTTP/1.1" status: 204 len: 168 time: 0.1952109 Sep 03 11:30:59.122108 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bde085e-af4d-476b-b7a1-abc5817cf13e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e0b853c-bbf9-4d9a-b717-6aa7b9446df7,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:30:59.790765 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-fb5b7651-aea4-4fa8-92d1-a725fa118ec4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:59.798505 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-fb5b7651-aea4-4fa8-92d1-a725fa118ec4 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.11 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0874138 Sep 03 11:30:59.890095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3847ba8c-01f8-4131-926f-93b7042599de req-f16ffa81-2076-4bc8-8925-ffe568629e10 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:30:59.904951 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3847ba8c-01f8-4131-926f-93b7042599de req-f16ffa81-2076-4bc8-8925-ffe568629e10 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 945 time: 0.0687346 Sep 03 11:30:59.980841 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3847ba8c-01f8-4131-926f-93b7042599de req-3eeddfe8-2b67-4d19-a9c3-596db6c707be tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/security-groups?id=f1d1fa78-60d5-419f-8d28-eedee2876319&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749135 Sep 03 11:30:59.983666 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Deleting port 1787e601-3fc1-4b10-b40f-019d14b569a6 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:30:59.984536 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:00.084446 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] For port 1787e601-3fc1-4b10-b40f-019d14b569a6, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1787e601-3fc1-4b10-b40f-019d14b569a6,segment=NetworkSegment(8483a2f2-1768-46a2-b6ca-7df7e3ec18b3),segment_id=8483a2f2-1768-46a2-b6ca-7df7e3ec18b3)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:00.084807 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:00.099181 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Calling delete_port for 1787e601-3fc1-4b10-b40f-019d14b569a6 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:31:00.316491 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:00.330029 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['1787e601-3fc1-4b10-b40f-019d14b569a6'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:00.347804 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Pushing event deleted for resources: {'Port': ['ID=1787e601-3fc1-4b10-b40f-019d14b569a6,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:00.482332 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] No DVR routers for this DVR port 1787e601-3fc1-4b10-b40f-019d14b569a6 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:31:00.485356 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:00.487467 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d14592b6-9c87-437d-a7f9-2d22b3507f13 req-62326879-b906-4836-af12-577065fadd2d tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.11 "DELETE /v2.0/ports/1787e601-3fc1-4b10-b40f-019d14b569a6 HTTP/1.1" status: 204 len: 173 time: 0.6818447 Sep 03 11:31:00.487988 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'name': 'network-vif-deleted', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:00.490389 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8588545a-3e22-43c9-a89a-3b5692ddbbe4" -d '{"events": [{"server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "name": "network-vif-deleted", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:00.525901 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46f5c43c-1780-4a6a-a0f0-f8d0d30ea035 x-openstack-request-id: req-46f5c43c-1780-4a6a-a0f0-f8d0d30ea035 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:00.526201 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f22535ab-fad5-4c7e-bebd-a4bb93dc1558", "name": "network-vif-deleted", "tag": "1787e601-3fc1-4b10-b40f-019d14b569a6", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:00.526538 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-46f5c43c-1780-4a6a-a0f0-f8d0d30ea035 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:00.526955 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f22535ab-fad5-4c7e-bebd-a4bb93dc1558', 'name': 'network-vif-deleted', 'tag': '1787e601-3fc1-4b10-b40f-019d14b569a6', 'status': 'completed', 'code': 200} Sep 03 11:31:01.066406 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e3aa0644-0d8b-4377-8614-a211e3653041 req-50ae1a9b-d308-4622-9d51-91f831dce4e6 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0250330 Sep 03 11:31:02.160277 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3450cdd4-43cf-40a8-b7fa-72837bfa3714 req-bbcc6d4a-fee7-4c73-ad8d-cdaf9e8832a7 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0252738 Sep 03 11:31:02.952211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-7cb07ee4-62ab-488d-a37b-97ac0e139175 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:02.953656 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-7cb07ee4-62ab-488d-a37b-97ac0e139175 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.1027405 Sep 03 11:31:02.968866 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-2886eb5b-b97f-498b-8a7b-cada7ea29143 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/quotas/7b665fdb80b4480ca82ebd31568efb7c HTTP/1.1" status: 200 len: 375 time: 0.0088873 Sep 03 11:31:03.017421 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-fcb4586c-bb1c-4788-8724-fb36ab83e9cf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0423124 Sep 03 11:31:03.107139 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-17b9465d-4c5a-487e-9990-475f2e3ecefe service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819128 Sep 03 11:31:03.381041 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-8119fc99-abb9-492a-b4e0-62402e8e171a service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2679362 Sep 03 11:31:03.618173 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bad44cb3-a386-4426-91b7-6069ca9d064b req-912e3af4-79b2-415d-8da6-4b50eab0f2e6 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0254376 Sep 03 11:31:03.682191 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a7393dba-df07-48d3-ac4e-5b918aa22258 req-9e6ee89d-3680-4770-b651-955805778aea tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0265014 Sep 03 11:31:03.690469 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1787e601-3fc1-4b10-b40f-019d14b569a6 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:31:03.715563 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 1787e601-3fc1-4b10-b40f-019d14b569a6 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:31:03.716229 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1787e601-3fc1-4b10-b40f-019d14b569a6 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:31:04.713867 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-76ac9307-c7d9-4143-aa6b-145cc677cf55 req-8c2fd2d7-2795-45eb-b9da-f96156591528 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0286283 Sep 03 11:31:04.798542 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7d05f749-6f7f-46e6-b7e9-5a0615d2da02 req-f9aface7-621e-4c38-9e3a-27c509a54b49 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0260034 Sep 03 11:31:05.820722 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db0dedf9-8fa8-4459-8dde-25aa7709a4a6 req-b41fc7e2-f407-4b2a-bff7-91cd5e130c75 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0257432 Sep 03 11:31:05.903136 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-df5c44f7-c2d3-4ef9-8c3d-765e2fc59d0d req-e7c7121f-1bc3-41be-8415-d7ba26d3ad7e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0294745 Sep 03 11:31:05.945440 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:31:06.913618 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3de842f2-9803-470b-8875-63ea52bc8acc req-e30679df-8ccf-4d49-9fc2-6ae634a821ce tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0247416 Sep 03 11:31:06.995936 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-958f3062-e1c6-465e-8cc0-a57fc2ed16ed req-610ef86e-75c6-4dc9-afad-a9da9a7278a2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0250432 Sep 03 11:31:08.025979 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8c8c5d9-5d8f-4595-b612-c88b5bdb06a9 req-52842d3a-a558-4cb5-8044-92e6f0c38dd2 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0287104 Sep 03 11:31:08.105236 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a5503196-ea46-4c45-be4b-f2a090c15357 req-cd9af909-a889-4563-9586-7d980592478a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0251210 Sep 03 11:31:09.132907 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cbcb86ca-e179-4198-9ae1-382b1602a72d req-6fe4a5c6-f0cc-4eb7-aa1f-5797e9678824 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0257566 Sep 03 11:31:09.204339 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e767cbd-a592-478e-a850-ab58fdc91daa req-dd174ae4-0001-4f00-ad2b-d5c84c8216ab tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0296464 Sep 03 11:31:10.243637 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-146be333-f451-46e1-9b4c-f3b7159dda7d req-2f5297f0-80ed-4076-9462-909caed2d849 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0251493 Sep 03 11:31:10.324253 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f09fce0-47d0-4df6-a552-4da587fc5c8f req-a80ba906-5e7a-4ab2-bc06-5a88703b7f69 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0257390 Sep 03 11:31:11.241313 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:11.359418 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3d774a6e-334b-4c2b-9332-03db3f5838ac req-1d1bbfef-22ad-41b2-a122-2544d21bba50 tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0288374 Sep 03 11:31:11.443950 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7fc995f5-5bfe-4937-b4f5-0e18092e62c7 req-c2b80e64-98e3-4b34-815c-66f97671fffc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0308962 Sep 03 11:31:12.230768 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-92d5b3b5-6c52-427a-a916-ee0641c29dc2 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0945792 Sep 03 11:31:12.245790 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-d6b39f76-1a2d-4cc7-9e01-6411e7bd5f36 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:12.247221 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-d6b39f76-1a2d-4cc7-9e01-6411e7bd5f36 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.1372616 Sep 03 11:31:12.270703 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Request body: {'port': {'device_id': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'admin_state_up': True, 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:12.375760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-40243777-199b-41a7-9b40-e1702bc8a8a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:12.377267 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-40243777-199b-41a7-9b40-e1702bc8a8a8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 1098 time: 0.1018677 Sep 03 11:31:12.484917 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a3855e92-ab2b-4905-9d06-25ccab0f5a46 req-dbf60993-9184-4a60-8ba5-9a1bf7ab3d7c tempest-DeleteServersTestJSON-1469840483 tempest-DeleteServersTestJSON-1469840483-project] 10.222.0.16 "GET /v2.0/ports?device_id=f22535ab-fad5-4c7e-bebd-a4bb93dc1558 HTTP/1.1" status: 200 len: 210 time: 0.0453858 Sep 03 11:31:12.507489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-6ab25f2c-d231-4697-9c81-cba7af9c5dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:12.512503 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-6ab25f2c-d231-4697-9c81-cba7af9c5dc9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 916 time: 0.1092439 Sep 03 11:31:12.532336 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:12.535684 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:12.559133 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-495801c0-010d-4677-aa80-14995227c882 req-c18ed8ac-1e42-478a-a5dc-f73febea90eb tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0259643 Sep 03 11:31:12.580311 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-0ecc9c71-3024-46ef-b763-b5cda9f77162 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 200 len: 217 time: 0.0499063 Sep 03 11:31:12.681542 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-1facc41e-3d28-4ccc-8046-d59b7c7a1151 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:12.682853 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-1facc41e-3d28-4ccc-8046-d59b7c7a1151 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0954583 Sep 03 11:31:12.923007 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-5c18c4f8-bff4-4057-8497-61dfbe3dc178 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2317908 Sep 03 11:31:12.959981 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Allocated IP 172.20.0.7 (778c15f4-3719-4d66-9e6d-1be38ac5cc42/c64b6662-4e29-47d5-96b7-4719ce1edb33/f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:13.070744 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-7cd05094-78ae-43f6-be62-c22e31f57036 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1379395 Sep 03 11:31:13.241121 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6b18109a-fdb5-4b19-a6e2-d19416739391 req-1558d346-e123-48db-b3ca-1b7b2fbf3a7a service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1566668 Sep 03 11:31:13.244137 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:13.389500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:13.402009 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:13.441053 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:13.444451 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:13.447448 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:13.453215 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:13.453819 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:13.471185 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event updated for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:13.550627 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-6989f91c-395e-449a-bc56-1351eb0d6ad4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2835886 Sep 03 11:31:13.566986 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Request body: {'port': {'device_id': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:13.639025 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:13.698554 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71593e1c-ddf9-4d2e-87a9-b6fbc705fc62 req-8cd7d62f-2591-4c80-a96f-2f57135d27c0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:13.706347 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-71593e1c-ddf9-4d2e-87a9-b6fbc705fc62 req-8cd7d62f-2591-4c80-a96f-2f57135d27c0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 931 time: 0.0741258 Sep 03 11:31:13.805728 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-71593e1c-ddf9-4d2e-87a9-b6fbc705fc62 req-271ee6a7-bbd9-4a3e-b0ef-38acf993101e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981946 Sep 03 11:31:13.987976 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:13.997524 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:14.012580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Transition to ACTIVE for port object f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:14.092240 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:14.148113 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Pushing event updated for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:14.183977 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Attempting to bind port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:14.184302 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Attempting to bind port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:14.184622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Attempting to bind port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:14.189058 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:31:14.189520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Attempting to bind port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:14.194870 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:14.195207 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Checking segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:14.195586 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Bound using segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:14.196504 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Bound port: f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:14.197052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:14.260990 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:14.264264 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:14.327839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:14.368649 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.369253 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:14.370669 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] 10.222.0.11 "PUT /v2.0/ports/f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 HTTP/1.1" status: 200 len: 1093 time: 0.8080158 Sep 03 11:31:14.371118 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:14.373360 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4b39801-787b-4c69-be9e-d2e975933a0a" -d '{"events": [{"name": "network-changed", "server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:14.405630 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3fb7f91-3a7f-40d2-8784-358f4e97f276 service neutron] Pushing event updated for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:14.435522 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91ec8735-a5ed-4503-9b55-75cdbc26f483 x-openstack-request-id: req-91ec8735-a5ed-4503-9b55-75cdbc26f483 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:14.435904 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:14.436160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-91ec8735-a5ed-4503-9b55-75cdbc26f483 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:14.436675 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', 'status': 'completed', 'code': 200} Sep 03 11:31:14.510344 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-4e7a73d9-f884-4781-88ed-9ddc12eb6507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.511881 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-4e7a73d9-f884-4781-88ed-9ddc12eb6507 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 1096 time: 0.0470037 Sep 03 11:31:14.617392 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-b4eb51c5-1fbe-4089-ab4c-49ae8cd624ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.620775 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-b4eb51c5-1fbe-4089-ab4c-49ae8cd624ea service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0997653 Sep 03 11:31:14.723429 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-24954873-c70a-406d-b7bf-b4542c3fd9f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.724933 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d4b39801-787b-4c69-be9e-d2e975933a0a req-24954873-c70a-406d-b7bf-b4542c3fd9f2 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0962806 Sep 03 11:31:14.811783 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-77ffc526-4053-49e9-b7e1-41246d33530c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.813327 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-77ffc526-4053-49e9-b7e1-41246d33530c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 1096 time: 0.0416858 Sep 03 11:31:14.869728 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-f8f95944-decf-4c75-9a33-0f1d80b2260c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 HTTP/1.1" status: 200 len: 217 time: 0.0381763 Sep 03 11:31:14.930891 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-4f96d131-60eb-49a4-a8ab-4087467f79ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.930891 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-4f96d131-60eb-49a4-a8ab-4087467f79ff service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0501409 Sep 03 11:31:14.949997 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75eabba9-2d7b-417c-9543-85442c38ad39 req-598e192d-938f-44c2-aa07-610b395960d5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:14.954118 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75eabba9-2d7b-417c-9543-85442c38ad39 req-598e192d-938f-44c2-aa07-610b395960d5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 943 time: 0.0776279 Sep 03 11:31:14.995499 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-7eb43250-8da0-4a21-abc5-522ecfbe61ea service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0592625 Sep 03 11:31:15.054989 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75eabba9-2d7b-417c-9543-85442c38ad39 req-55c36e91-7bae-4450-949f-c89c07603229 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921004 Sep 03 11:31:15.117780 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-ee310dda-233b-4aa7-b1fb-798210d320d7 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1138163 Sep 03 11:31:15.228959 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f992b3cb-9edb-4606-81b4-e7533d79a894 req-3e04c0e2-5a93-4b93-beb4-3febd3fa6e55 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0968747 Sep 03 11:31:15.550417 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 32996) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:15.601941 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Deleting subnet 6c707ad6-c2c1-4d5a-a165-571e0df41796 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:31:15.605667 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:15.652509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:15.693309 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:15.831010 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:15.856900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6c707ad6-c2c1-4d5a-a165-571e0df41796,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:15.860602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:15.863303 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-237dd756-e914-4009-8273-196a07c16e59 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/6c707ad6-c2c1-4d5a-a165-571e0df41796 HTTP/1.1" status: 204 len: 168 time: 0.3109281 Sep 03 11:31:15.865137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33004) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:15.931831 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.013114 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.023124 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e4ae560a-b704-4763-8338-c0b652784a4f']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:16.034580 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:16.034732 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8483a2f2-1768-46a2-b6ca-7df7e3ec18b3') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:16.044902 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.058765 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.064541 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Releasing vlan 353 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:31:16.064916 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:31:16.066541 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:31:16.182990 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7265554f-aa3e-48c2-a419-29403791fb4e req-2d3d4709-1e1d-40c3-a0db-001b80f586ba tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:16.184826 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7265554f-aa3e-48c2-a419-29403791fb4e req-2d3d4709-1e1d-40c3-a0db-001b80f586ba tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 943 time: 0.0528529 Sep 03 11:31:16.186197 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.194204 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.199873 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] 10.222.0.16 "DELETE /v2.0/networks/e4ae560a-b704-4763-8338-c0b652784a4f HTTP/1.1" status: 204 len: 168 time: 0.3299825 Sep 03 11:31:16.218873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efa69dc-d043-4708-9a98-36c0b4ed5280 admin admin] Pushing event deleted for resources: {'Network': ['ID=e4ae560a-b704-4763-8338-c0b652784a4f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:16.259892 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7265554f-aa3e-48c2-a419-29403791fb4e req-a8518199-682d-4ca2-9e19-3d955a878a5a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393205 Sep 03 11:31:16.627708 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33032) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:16.674988 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-098c89ce-2309-4cdf-8e2c-d6d8d6e9cf75 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=74f263fc57094cad9ed742802a83bff8&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0457220 Sep 03 11:31:16.677421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33036) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:16.727028 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.756633 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.881071 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.884317 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:16.888469 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f1d1fa78-60d5-419f-8d28-eedee2876319 HTTP/1.1" status: 204 len: 168 time: 0.2073236 Sep 03 11:31:16.893489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf79bc5c-17cc-43c2-8ad3-640808cc6b19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1d1fa78-60d5-419f-8d28-eedee2876319,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:16.945362 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:31:17.047035 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:17.059576 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'port_id': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', 'mac_address': 'fa:16:3e:99:6e:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c64b6662-4e29-47d5-96b7-4719ce1edb33', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:31:17.100115 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:17.114046 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:17.137492 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:17.218346 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:17.273545 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:17.274890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.275267 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.275615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.275955 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.276284 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.276612 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.276936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.277261 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.277606 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.277935 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.278238 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.278580 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:17.381922 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff4f404-9a76-4268-ab97-bcd0abaed215 req-9508df02-d8da-424c-b3b7-94306c96d66b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:17.383505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cff4f404-9a76-4268-ab97-bcd0abaed215 req-9508df02-d8da-424c-b3b7-94306c96d66b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 944 time: 0.0546525 Sep 03 11:31:17.435652 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cff4f404-9a76-4268-ab97-bcd0abaed215 req-d9618acb-2152-4b20-843a-92864671ed0f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397635 Sep 03 11:31:17.508515 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:18.161226 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33102) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:18.242598 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33108) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:18.343943 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-206874543-network', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:18.365222 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54a30803-46da-45e2-84a3-fcf46eb59e79 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.459596 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Made reservation on behalf of c3b2e7b58ddb4de5bf42ff1786108e9a for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:18.461947 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.477584 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.568110 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fcaa72-70ac-4150-ac57-01482aacfb18 req-1a2f8c79-72fc-4505-be50-77e45b8a7188 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:18.569720 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e3fcaa72-70ac-4150-ac57-01482aacfb18 req-1a2f8c79-72fc-4505-be50-77e45b8a7188 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 944 time: 0.0626366 Sep 03 11:31:18.580084 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54a30803-46da-45e2-84a3-fcf46eb59e79 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.623500 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e3fcaa72-70ac-4150-ac57-01482aacfb18 req-fb09975f-54a3-4cb4-a8e6-5a8960154df3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467732 Sep 03 11:31:18.646964 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54a30803-46da-45e2-84a3-fcf46eb59e79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.713086 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-54a30803-46da-45e2-84a3-fcf46eb59e79 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=60fe2cb2f6464d459ca4888cfe253e72&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5499737 Sep 03 11:31:18.718726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33114) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:18.719073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a30803-46da-45e2-84a3-fcf46eb59e79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac167c35-11b8-4787-86fd-b72a807f1077,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:18.790876 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.804198 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.816921 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.922190 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:18.961895 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec112d21-7995-406c-a4c6-878ef7f3c178,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:18.975576 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:19.069136 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.072009 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.076063 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/ac167c35-11b8-4787-86fd-b72a807f1077 HTTP/1.1" status: 204 len: 168 time: 0.3533459 Sep 03 11:31:19.076219 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] vlan segment allocate from pool success with {'vlan_id': 363, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:31:19.085158 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f35121e-d67a-4adc-8890-c3660d934ccf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac167c35-11b8-4787-86fd-b72a807f1077,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:19.091688 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.092252 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Added segment 56638015-f78b-4c41-bcc1-ec6d8ef4f101 of type vlan for network 29b4f20f-4a29-4a98-9a98-c60b1b87931c Sep 03 11:31:19.152891 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.190640 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:19.195728 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:19.196158 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.276581 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.278346 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:19.279154 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.284974 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.327532 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:19.328871 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85b7b85d-b54f-4f5f-9bbd-be9e80dd8630" -d '{"events": [{"server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "name": "network-vif-plugged", "status": "completed", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:19.344875 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:19.376697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] Pushing event updated for resources: {'Network': ['ID=29b4f20f-4a29-4a98-9a98-c60b1b87931c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:19.377367 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7989a11-77a7-4f78-b45b-6f789b5d1d59 x-openstack-request-id: req-c7989a11-77a7-4f78-b45b-6f789b5d1d59 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:19.377660 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "name": "network-vif-plugged", "status": "completed", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:19.377911 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c7989a11-77a7-4f78-b45b-6f789b5d1d59 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:19.378668 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', 'code': 200} Sep 03 11:31:19.386608 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-95f8b0c8-ef99-4b84-bcc1-56fde46436b2 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.1412368 Sep 03 11:31:19.389364 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33142) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:19.391564 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:31:19.399500 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Request body: {'subnet': {'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-subnet', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:19.412888 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.492105 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Made reservation on behalf of c3b2e7b58ddb4de5bf42ff1786108e9a for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:19.495069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.545374 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:19.788108 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e7b924f-c377-431a-b7c8-f38afb93a506 req-49cc21d2-eaf7-4259-bec0-24d815648adf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:19.789613 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4e7b924f-c377-431a-b7c8-f38afb93a506 req-49cc21d2-eaf7-4259-bec0-24d815648adf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0518801 Sep 03 11:31:19.831666 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.879827 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33158) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:19.879827 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4e7b924f-c377-431a-b7c8-f38afb93a506 req-654545d6-da5c-4a05-a94f-dda22c0d4cfd tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796709 Sep 03 11:31:19.893106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec454c1b-a372-4023-a6de-b91b1834bcc9 req-3a283661-8d86-4c39-be10-3a84de068c53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:19.895021 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ec454c1b-a372-4023-a6de-b91b1834bcc9 req-3a283661-8d86-4c39-be10-3a84de068c53 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 1098 time: 0.0565591 Sep 03 11:31:19.923379 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dfefd9f2-af81-45a5-b015-02d13c801c13 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:19.938609 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ec454c1b-a372-4023-a6de-b91b1834bcc9 req-f21d611d-03c5-42f6-a9f3-8c87fbf7641e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345211 Sep 03 11:31:19.947968 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d8dac57-65e4-4460-baea-bbf51d76bcf1,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:19.954140 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Checking segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:19.954526 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Network hostable DHCP agents. Network: 29b4f20f-4a29-4a98-9a98-c60b1b87931c, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:31:20.056623 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dfefd9f2-af81-45a5-b015-02d13c801c13 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.057074 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33162) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:20.087701 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:31:20.121124 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dfefd9f2-af81-45a5-b015-02d13c801c13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.150691 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 29b4f20f-4a29-4a98-9a98-c60b1b87931c) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:20.166674 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-dfefd9f2-af81-45a5-b015-02d13c801c13 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=40d0c02f70a540fc96b798fce5220ba0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2830188 Sep 03 11:31:20.166674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:20.166674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.171595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33168) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:20.176337 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e662b901-1d50-4600-9f6c-a0928dd42b24 None None] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:20.186885 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3bc3dfe-0610-4a55-991f-6525f7a42182 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.195964 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfefd9f2-af81-45a5-b015-02d13c801c13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=821c9d2c-8881-4b77-b09b-c597ef3b579b,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:20.242505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-16b61392-3c33-4d57-b67a-5e71c358b7ca admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.8511460 Sep 03 11:31:20.246137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33170) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:20.251646 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:20.268858 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.304032 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.395742 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3bc3dfe-0610-4a55-991f-6525f7a42182 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.437604 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3ca7377-477d-4563-b532-8e33cdd5e766 None None] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:20.469715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3bc3dfe-0610-4a55-991f-6525f7a42182 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.472363 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.474998 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.479186 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/821c9d2c-8881-4b77-b09b-c597ef3b579b HTTP/1.1" status: 204 len: 168 time: 0.3028042 Sep 03 11:31:20.517349 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e3bc3dfe-0610-4a55-991f-6525f7a42182 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=85715a21e38443929e4936836403a75e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4568238 Sep 03 11:31:20.517349 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3bc3dfe-0610-4a55-991f-6525f7a42182 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25370ecf-ff39-4fcf-b847-b22d1c1db3d9,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:20.517736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33176) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:20.532820 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194590be-54ee-4102-b482-d19c0b116261 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=821c9d2c-8881-4b77-b09b-c597ef3b579b,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:20.553555 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.554661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.633682 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.673211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.697234 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.970711 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.978608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:20.978608 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/25370ecf-ff39-4fcf-b847-b22d1c1db3d9 HTTP/1.1" status: 204 len: 168 time: 0.4560394 Sep 03 11:31:21.031313 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:21.042007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4521e302-10e6-4a2c-9bab-af297e595571 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25370ecf-ff39-4fcf-b847-b22d1c1db3d9,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:21.065933 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651b0ec1-28ce-4b67-a131-b7cd14faaaba req-d3b4a61c-1f50-43a7-b71b-398776a31738 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:21.067050 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-651b0ec1-28ce-4b67-a131-b7cd14faaaba req-d3b4a61c-1f50-43a7-b71b-398776a31738 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.1000295 Sep 03 11:31:21.113401 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-651b0ec1-28ce-4b67-a131-b7cd14faaaba req-83ba4b98-effb-44c4-8696-3480301e0fa7 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388808 Sep 03 11:31:21.385680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:21.407481 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:21.538745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Allocated IP 172.27.0.90 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/472048d9-0404-466a-aee8-6fe033180afb) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:21.644736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:21.778316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:21.814711 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:21.816915 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:21.820576 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:21.848368 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Pushing event updated for resources: {'Port': ['ID=472048d9-0404-466a-aee8-6fe033180afb,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:21.895705 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33230) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:21.909567 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1a3ad122-fb07-4a77-87b2-c575ec5fb5e2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.020144 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1a3ad122-fb07-4a77-87b2-c575ec5fb5e2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.069752 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1a3ad122-fb07-4a77-87b2-c575ec5fb5e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.153066 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1a3ad122-fb07-4a77-87b2-c575ec5fb5e2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a005f14c700641d0b06337cb46f3d5f3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2561641 Sep 03 11:31:22.155791 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33250) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:22.157498 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3ad122-fb07-4a77-87b2-c575ec5fb5e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ae3a12a-4635-4e61-b688-a92dfc07a125,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:22.204805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.518458 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.532854 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c88fabea-4092-4017-9236-b9710f924f30 req-fb1b5253-3312-4b11-9bcc-9d598b11bb58 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:22.534423 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c88fabea-4092-4017-9236-b9710f924f30 req-fb1b5253-3312-4b11-9bcc-9d598b11bb58 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.3314848 Sep 03 11:31:22.578619 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.682108 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c88fabea-4092-4017-9236-b9710f924f30 req-54f9cb18-02a5-4a87-8987-ca7b19306390 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1363504 Sep 03 11:31:22.721317 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.830679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.833155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:22.834395 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9ae3a12a-4635-4e61-b688-a92dfc07a125 HTTP/1.1" status: 204 len: 168 time: 0.6776731 Sep 03 11:31:22.846617 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b173eb7-2e88-4975-93fb-c4b30ce5188e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ae3a12a-4635-4e61-b688-a92dfc07a125,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:22.944503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94433) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:31:23.070918 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:23.095649 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Sync routers for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:23.097575 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:23.098200 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:30:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:23.189625 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:23.194196 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a3a4b570-765a-469e-8df3-daa233477e70 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 2.9434965 Sep 03 11:31:23.194278 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33292) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:23.251460 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:23.473761 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:21Z', 'revision_number': 3, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:23.505620 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Checking router: dfe58ee8-bef9-4270-ba83-cf583ac6d5dc for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:23.505968 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Updating router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc port 472048d9-0404-466a-aee8-6fe033180afb binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:23.536906 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:23.693155 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-44ea1c02-2747-4fa6-944d-ac34ed922e72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:23.760510 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:23.955072 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:23.968629 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Transition to ACTIVE for port object 472048d9-0404-466a-aee8-6fe033180afb will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:23.984816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Allocated IP 172.20.0.1 (29b4f20f-4a29-4a98-9a98-c60b1b87931c/2d8dac57-65e4-4460-baea-bbf51d76bcf1/543b2a9c-76dc-46d9-9c41-9b1560b4608c) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:24.064014 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.128246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.137098 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Pushing event updated for resources: {'Port': ['ID=472048d9-0404-466a-aee8-6fe033180afb,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:24.159948 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Attempting to bind port 472048d9-0404-466a-aee8-6fe033180afb on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:24.160574 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Attempting to bind port 472048d9-0404-466a-aee8-6fe033180afb by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:24.161152 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Attempting to bind port 472048d9-0404-466a-aee8-6fe033180afb on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:24.168499 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.169182 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.169756 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.170311 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.170898 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.171442 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.172111 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.173001 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.173532 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.174050 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.174775 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.175306 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:24.180268 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 30, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:24.180794 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:24.181304 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.181819 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:24.182365 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Bound port: 472048d9-0404-466a-aee8-6fe033180afb, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:24.182880 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.243821 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] For port 472048d9-0404-466a-aee8-6fe033180afb, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:24.253615 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] For port 472048d9-0404-466a-aee8-6fe033180afb, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=472048d9-0404-466a-aee8-6fe033180afb,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:24.269848 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.312747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:24.315542 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:24.319304 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:24.319778 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.321553 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.356326 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Pushing event updated for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:24.376949 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:24.377580 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:30:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:24.449757 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f618411-27e5-487d-8ee3-ad8aca303d7e None None] Pushing event updated for resources: {'Port': ['ID=472048d9-0404-466a-aee8-6fe033180afb,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:24.501100 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:24.557844 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.681755 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:21Z', 'revision_number': 3, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:24.717878 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14fa5937-fbb1-4170-a4b5-902a96c6ee75 None None] The sync data for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi is: [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:21Z', 'revision_number': 3, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:24.738502 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.806948 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.807710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:24.879686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Pushing event updated for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:24.985557 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:24.986805 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:25.158941 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:31:25.522322 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:25.527834 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-54f2ec2c-84bf-4d29-9270-2439e6463953 admin admin] 10.222.0.16 "PUT /v2.0/routers/dfe58ee8-bef9-4270-ba83-cf583ac6d5dc/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3216085 Sep 03 11:31:26.001606 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-0ab3ec43-2f77-475e-b5bd-be7594d2c993 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:26.003114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-0ab3ec43-2f77-475e-b5bd-be7594d2c993 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 818 time: 0.1062870 Sep 03 11:31:26.018924 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-b98cb21b-629b-4cf9-9fb2-d060223c823f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/quotas/c3b2e7b58ddb4de5bf42ff1786108e9a HTTP/1.1" status: 200 len: 375 time: 0.0093882 Sep 03 11:31:26.066549 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-f65bd668-3ab9-4c18-a958-154607c2af61 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0420034 Sep 03 11:31:26.168885 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-6484eea0-3974-4852-a923-db42428ff0fd service neutron] 10.222.0.16 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944076 Sep 03 11:31:26.274483 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-ee8ca1e7-b339-487a-a0b8-4f5f8cb28d2b service neutron] 10.222.0.16 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992343 Sep 03 11:31:26.349976 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4bb2ef06-928e-46c9-a305-52cddedd7e4e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:26.557439 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Sync routers for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:26.570532 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:26.571289 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:26.618422 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7cb77bbb-6178-49dc-9408-c394f3689d65 req-5ec92734-d63c-478d-808b-37606e6e1d6e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 210 time: 0.0324697 Sep 03 11:31:26.703969 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:26.778705 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:26.845898 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 472048d9-0404-466a-aee8-6fe033180afb up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:26.882758 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-f7bf9734-aaf1-45ed-a994-542ae6525819 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:26.884504 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-f7bf9734-aaf1-45ed-a994-542ae6525819 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 818 time: 0.1218903 Sep 03 11:31:26.900578 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-0a851802-5679-4094-bfa9-4ee7b1263690 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/quotas/c3b2e7b58ddb4de5bf42ff1786108e9a HTTP/1.1" status: 200 len: 375 time: 0.0097883 Sep 03 11:31:26.957737 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-5d9d2dde-9041-41a0-99eb-5793c0c46f34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0510981 Sep 03 11:31:26.966655 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 4, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '543b2a9c-76dc-46d9-9c41-9b1560b4608c', 'name': '', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'mac_address': 'fa:16:3e:8a:f3:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 257, 'fixed_ips': [{'subnet_id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:23Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 2, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'subnets': [{'id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:26.994662 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Checking router: dfe58ee8-bef9-4270-ba83-cf583ac6d5dc for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:26.995016 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Updating router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc port 543b2a9c-76dc-46d9-9c41-9b1560b4608c binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:27.012313 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 472048d9-0404-466a-aee8-6fe033180afb completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:27.018790 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 472048d9-0404-466a-aee8-6fe033180afb triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:27.019158 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.040830 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.052373 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-185bd7e5-acc9-4bce-a2d7-2ee6302058c9 service neutron] 10.222.0.16 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932932 Sep 03 11:31:27.146706 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-59ee89f9-47b6-46e5-a81c-511c33b9f6a7 service neutron] 10.222.0.16 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854089 Sep 03 11:31:27.215073 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.276132 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 472048d9-0404-466a-aee8-6fe033180afb, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=472048d9-0404-466a-aee8-6fe033180afb,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:27.373661 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.399064 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.422660 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dc2fe5d8-2088-4a0b-8f1a-3662737b1aa7 req-c2a8fcda-785e-47c8-a6f3-665f80c995fb tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 210 time: 0.0551724 Sep 03 11:31:27.463237 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Transition to ACTIVE for port object 543b2a9c-76dc-46d9-9c41-9b1560b4608c will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:27.466796 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=472048d9-0404-466a-aee8-6fe033180afb,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:27.532027 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.594494 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795c466a-d153-4af1-8049-5d4ce5e91e69 None None] Pushing event updated for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:27.659456 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.661872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Attempting to bind port 543b2a9c-76dc-46d9-9c41-9b1560b4608c on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:27.662243 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Attempting to bind port 543b2a9c-76dc-46d9-9c41-9b1560b4608c by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:27.662637 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Attempting to bind port 543b2a9c-76dc-46d9-9c41-9b1560b4608c on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:27.668476 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:27.668859 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Checking segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:27.669249 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.669785 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Bound using segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:27.670617 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Bound port: 543b2a9c-76dc-46d9-9c41-9b1560b4608c, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:27.671000 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.740936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] For port 543b2a9c-76dc-46d9-9c41-9b1560b4608c, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:27.744762 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] For port 543b2a9c-76dc-46d9-9c41-9b1560b4608c, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=543b2a9c-76dc-46d9-9c41-9b1560b4608c,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:27.830082 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:27.894286 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:27.897710 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:27.898686 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-795c466a-d153-4af1-8049-5d4ce5e91e69 None None] Pushing event updated for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:28.006197 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:28.229291 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 4, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '543b2a9c-76dc-46d9-9c41-9b1560b4608c', 'name': '', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'mac_address': 'fa:16:3e:8a:f3:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 257, 'fixed_ips': [{'subnet_id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:23Z', 'updated_at': '2021-09-03T11:31:27Z', 'revision_number': 4, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'subnets': [{'id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:28.265695 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf92444a-eabd-49d8-8a4f-76e54fe58c9f None None] The sync data for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi is: [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:31:24Z', 'revision_number': 4, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '543b2a9c-76dc-46d9-9c41-9b1560b4608c', 'name': '', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'mac_address': 'fa:16:3e:8a:f3:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_interface', 'standard_attr_id': 257, 'fixed_ips': [{'subnet_id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:23Z', 'updated_at': '2021-09-03T11:31:27Z', 'revision_number': 4, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'subnets': [{'id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:28.536118 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50336c56-2409-4008-b25d-37081d4c961a req-0efa6572-67db-4e8e-9a0f-5b1af7a275fe tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 210 time: 0.0269485 Sep 03 11:31:28.543875 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33514) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:28.612570 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Deleting subnet 62ebfcfd-f616-4f75-93fe-db32716b171a {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:31:28.616724 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:28.710967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:28.726159 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:28.968488 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 543b2a9c-76dc-46d9-9c41-9b1560b4608c up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:29.007385 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-8f207b28-8a50-4753-bb2d-7e2b71a9501f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:29.012060 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-8f207b28-8a50-4753-bb2d-7e2b71a9501f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 818 time: 0.1569874 Sep 03 11:31:29.016967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.101247 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Request body: {'port': {'device_id': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'admin_state_up': True, 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:29.154564 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62ebfcfd-f616-4f75-93fe-db32716b171a,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:29.173053 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.188174 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e80f6d41-e18b-4a9b-b06c-792ec9a41ef8 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/62ebfcfd-f616-4f75-93fe-db32716b171a HTTP/1.1" status: 204 len: 168 time: 0.6431956 Sep 03 11:31:29.192999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33548) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:29.293568 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.309465 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-418875f6-8ce3-49e4-b906-a57ba1300fb4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:29.312307 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-418875f6-8ce3-49e4-b906-a57ba1300fb4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.2537262 Sep 03 11:31:29.341789 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-72a4f577-1f49-4ad6-8c09-320ff55cca01 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/quotas/7b665fdb80b4480ca82ebd31568efb7c HTTP/1.1" status: 200 len: 375 time: 0.0201793 Sep 03 11:31:29.388966 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 543b2a9c-76dc-46d9-9c41-9b1560b4608c completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:29.395945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 543b2a9c-76dc-46d9-9c41-9b1560b4608c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:29.396389 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.405726 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.447617 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-1b91fa24-edfc-4f87-a771-b3af7941e0aa tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1084464 Sep 03 11:31:29.567860 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-f1a5e21c-5c3c-4ebf-bed2-c2a6f99ba4d7 service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1186957 Sep 03 11:31:29.577277 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.636030 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.662673 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 543b2a9c-76dc-46d9-9c41-9b1560b4608c, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=543b2a9c-76dc-46d9-9c41-9b1560b4608c,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:29.670638 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.671167 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.672114 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.672590 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > port after_create 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.673080 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > port after_delete 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.673419 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > port after_update 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.673755 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.674098 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.674567 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.674760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.717576 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ec3a6ce0-324b-48d1-ad99-0492faae35ce service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1484160 Sep 03 11:31:29.755928 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.756851 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 472048d9-0404-466a-aee8-6fe033180afb up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:29.799821 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cc2f80c-14d2-48b8-b16a-d26474db9d6e req-cc44ed84-35ca-4545-b6ce-06728684ee98 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 210 time: 0.0541635 Sep 03 11:31:29.853863 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:29.868885 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 472048d9-0404-466a-aee8-6fe033180afb triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:29.869281 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:29.904954 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.905564 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.905914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.906255 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=94432) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 03 11:31:29.906675 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0865e185-e75b-4fae-a3f3-139bddc92396']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:29.947753 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b0a799c1-5360-4aac-b91f-38caac33a00c') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:29.948155 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b0a799c1-5360-4aac-b91f-38caac33a00c') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:29.979470 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.033107 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Made reservation on behalf of c3b2e7b58ddb4de5bf42ff1786108e9a for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:30.037008 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.039459 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.062503 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Releasing vlan 383 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:31:30.063102 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.144281 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-728df01e-cf43-4c9f-b0ae-8fb6fcb8999a req-b64a5834-2c59-4d7f-90b8-bea7a371265b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0442228 Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: from cryptography.utils import int_from_bytes Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: from cryptography.utils import int_from_bytes Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:31:30.181281 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:31:30.278006 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-62ccb14e-2a31-4b4a-a5b8-c1a7b6525d0e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:30.279659 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-62ccb14e-2a31-4b4a-a5b8-c1a7b6525d0e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 818 time: 0.3664870 Sep 03 11:31:30.297939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33590) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:30.314617 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.325288 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Request body: {'port': {'device_id': '2f708893-5470-4377-adde-08d9db3a42e6', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'admin_state_up': True, 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:30.361999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.363904 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] 10.222.0.16 "DELETE /v2.0/networks/0865e185-e75b-4fae-a3f3-139bddc92396 HTTP/1.1" status: 204 len: 168 time: 1.1700401 Sep 03 11:31:30.367132 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33594) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:30.370875 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e964933e-cf59-49f8-bfd1-fb1f7b80368e admin admin] Pushing event deleted for resources: {'Network': ['ID=0865e185-e75b-4fae-a3f3-139bddc92396,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:30.456020 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8544bd94-09f1-4a3c-9852-f38232871511 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.515661 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Deleting subnet 45ffb1df-94f7-4d6b-8964-1960a7f4a7b6 {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:31:30.522085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.576653 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Allocated IP 172.20.0.6 (29b4f20f-4a29-4a98-9a98-c60b1b87931c/2d8dac57-65e4-4460-baea-bbf51d76bcf1/8dba3504-1d0d-4e2a-9da3-d44f9f95684d) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:30.598767 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.616119 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8544bd94-09f1-4a3c-9852-f38232871511 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.669466 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.710703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8544bd94-09f1-4a3c-9852-f38232871511 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.824602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8544bd94-09f1-4a3c-9852-f38232871511 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd56591c-b76e-4d8d-9f45-9ac2d9484b63,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:30.829054 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 543b2a9c-76dc-46d9-9c41-9b1560b4608c up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:30.834500 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8544bd94-09f1-4a3c-9852-f38232871511 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fbe24e1183734517afd25e832b3fd63a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5321362 Sep 03 11:31:30.835866 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33622) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:30.886720 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33624) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:30.895359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.900449 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Made reservation on behalf of c3b2e7b58ddb4de5bf42ff1786108e9a for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:30.904470 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.929119 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 543b2a9c-76dc-46d9-9c41-9b1560b4608c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:30.929495 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.933939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.942439 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:30.980865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.023432 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=45ffb1df-94f7-4d6b-8964-1960a7f4a7b6,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.029772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.031714 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9e5f3d85-8093-446f-a0a8-62a9a68ae1b1 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/45ffb1df-94f7-4d6b-8964-1960a7f4a7b6 HTTP/1.1" status: 204 len: 168 time: 0.6585896 Sep 03 11:31:31.037481 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33628) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:31.076466 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e100d6e-373f-41a3-8d63-1684233bbcd6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.123456 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.206841 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.218907 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.221968 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.225782 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/bd56591c-b76e-4d8d-9f45-9ac2d9484b63 HTTP/1.1" status: 204 len: 168 time: 0.3857846 Sep 03 11:31:31.263502 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1cd08e67-d8a3-4cdd-ac68-b88fa8101e2f req-11c18267-b04b-41a8-af8c-bf9376a44d7e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 210 time: 0.0647850 Sep 03 11:31:31.284035 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.285626 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f15f3a8-2f30-49c5-b9a0-d97f8d7fc67f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd56591c-b76e-4d8d-9f45-9ac2d9484b63,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.320799 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c4e82f77-63fa-4c42-9f95-bcabcc585587 req-2fc73a98-f4cc-44ee-a288-bb7841784aa8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0797806 Sep 03 11:31:31.325348 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b1cf043-ef05-4691-b186-cc507a0dc8d2']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:31.350779 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:31.352520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'afbc2ec9-97a0-427a-aa8b-220e0eb6a393') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:31.352835 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'afbc2ec9-97a0-427a-aa8b-220e0eb6a393') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:31.368109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:31.371475 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e100d6e-373f-41a3-8d63-1684233bbcd6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.375098 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:31.377979 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Allocated IP 172.20.0.9 (29b4f20f-4a29-4a98-9a98-c60b1b87931c/2d8dac57-65e4-4460-baea-bbf51d76bcf1/1ec235e2-d042-4026-bdc2-da77b096452b) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:31.380069 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Pushing event updated for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.384506 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.428672 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.457869 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e100d6e-373f-41a3-8d63-1684233bbcd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.458974 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Releasing vlan 379 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:31:31.459377 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:31:31.461056 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:31:31.491276 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:31.491923 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.512499 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e100d6e-373f-41a3-8d63-1684233bbcd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=097660fa-5ed2-4f3e-94e5-5371e8d825bc,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.528098 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-9e100d6e-373f-41a3-8d63-1684233bbcd6 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6d65050b96bb4752af959a04ae684628&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6402671 Sep 03 11:31:31.531090 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33640) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:31.590032 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.612950 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.622434 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.624567 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-ca1ffd49-db2f-4679-9242-0ed0e7d3cdd7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5294702 Sep 03 11:31:31.638132 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.640020 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] 10.222.0.16 "DELETE /v2.0/networks/6b1cf043-ef05-4691-b186-cc507a0dc8d2 HTTP/1.1" status: 204 len: 168 time: 0.6016035 Sep 03 11:31:31.655696 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad03cb9-c1ff-4fc1-90c0-6925600f7e9b admin admin] Pushing event deleted for resources: {'Network': ['ID=6b1cf043-ef05-4691-b186-cc507a0dc8d2,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.687634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.772305 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.775385 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.778931 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/097660fa-5ed2-4f3e-94e5-5371e8d825bc HTTP/1.1" status: 204 len: 168 time: 0.2444882 Sep 03 11:31:31.784887 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b100454-f105-40c8-afbf-a446de5f8986 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=097660fa-5ed2-4f3e-94e5-5371e8d825bc,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.829822 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.871188 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Network 29b4f20f-4a29-4a98-9a98-c60b1b87931c is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:31.874215 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:31.877786 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:31.907498 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Pushing event updated for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:31.926229 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33650) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:31.939021 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:31.939682 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.940510 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-045b2e7d-8965-401b-b950-496c40bbf60d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:31.990155 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-8204759a-ed01-47fd-95de-68bcff7c99f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6733394 Sep 03 11:31:31.997701 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33652) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:32.039517 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d64ef9ac-0303-41b1-b5a5-53b4ea4fb91e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c35f426e843b4862bf0cdd55f67069d9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0404902 Sep 03 11:31:32.042508 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33654) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:32.073104 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-045b2e7d-8965-401b-b950-496c40bbf60d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.094334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.116364 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.143749 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-045b2e7d-8965-401b-b950-496c40bbf60d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.183243 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-045b2e7d-8965-401b-b950-496c40bbf60d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f46e0d78-ce8c-4da4-8e8a-ee9f16bdb70b,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:32.187320 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-045b2e7d-8965-401b-b950-496c40bbf60d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8bccc487ea6f4d96be5bde4a513b320e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2600653 Sep 03 11:31:32.190686 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33656) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:32.238090 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.240064 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.240656 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.241899 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/72c3ccbb-ec16-46b6-bc41-55f6cc47f55a HTTP/1.1" status: 204 len: 168 time: 0.1983738 Sep 03 11:31:32.250890 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc24f0c2-7fe6-43b9-b91e-5f47492f31ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72c3ccbb-ec16-46b6-bc41-55f6cc47f55a,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:32.280142 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.386690 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3744b903-0437-480a-b7e2-63b2a309f2ac req-7f1a134d-9534-45b5-ad91-15f0b318eb6f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:32.389269 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3744b903-0437-480a-b7e2-63b2a309f2ac req-7f1a134d-9534-45b5-ad91-15f0b318eb6f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 931 time: 0.0495858 Sep 03 11:31:32.407823 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.410401 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.411453 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f46e0d78-ce8c-4da4-8e8a-ee9f16bdb70b HTTP/1.1" status: 204 len: 168 time: 0.2205276 Sep 03 11:31:32.424608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c10987-2dc6-48d2-b88e-18cae78c0587 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f46e0d78-ce8c-4da4-8e8a-ee9f16bdb70b,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:32.437926 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3744b903-0437-480a-b7e2-63b2a309f2ac req-fa78012f-fdf6-4d78-ac44-e3c63470854d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434647 Sep 03 11:31:32.522734 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-95d9a3ed-c468-4f21-bdc9-3648ede3082f req-5fef098a-00df-431c-b657-dcf7680aada3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0295777 Sep 03 11:31:32.716407 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33674) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:32.730755 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89a965f9-8fd4-4c70-8080-9614df1fa8c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.832661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89a965f9-8fd4-4c70-8080-9614df1fa8c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.915340 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-89a965f9-8fd4-4c70-8080-9614df1fa8c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:32.957983 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-89a965f9-8fd4-4c70-8080-9614df1fa8c4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c41ec5386bd640d8934cc67decd402d4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2381084 Sep 03 11:31:32.957983 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a965f9-8fd4-4c70-8080-9614df1fa8c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e9bf28a-8303-4aed-9642-b9998f250078,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:32.958437 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33680) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:33.011094 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.035148 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.058713 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33684) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:33.105096 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-142c71c6-4246-4eca-b0cf-79727823002e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ddab1c3ee3124d939f0a6fdc8ef30a6b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0451255 Sep 03 11:31:33.107599 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33686) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:33.121128 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.124996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.126349 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6e9bf28a-8303-4aed-9642-b9998f250078 HTTP/1.1" status: 204 len: 168 time: 0.1658196 Sep 03 11:31:33.139668 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e254e4-c86d-4ae3-b6ab-a4087d7d961b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e9bf28a-8303-4aed-9642-b9998f250078,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:33.179445 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.203396 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.303925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.307699 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:33.309571 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/cfbb6f51-9df1-4c44-8934-2defd377d10f HTTP/1.1" status: 204 len: 168 time: 0.2003443 Sep 03 11:31:33.316701 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a26286d-433c-4005-950e-19cc02d8d861 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfbb6f51-9df1-4c44-8934-2defd377d10f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:33.556664 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1914c2-bd0e-424b-af8b-2a2c23cbfd7b req-5b77738a-4a10-4d8e-98d6-3147817ee6af tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:33.558641 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac1914c2-bd0e-424b-af8b-2a2c23cbfd7b req-5b77738a-4a10-4d8e-98d6-3147817ee6af tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 931 time: 0.0534887 Sep 03 11:31:33.603968 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac1914c2-bd0e-424b-af8b-2a2c23cbfd7b req-73dfdf14-1a5c-4507-92e8-3024d7d0f4a5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390837 Sep 03 11:31:33.709202 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-078d02ac-3b05-43e4-ab76-6ef934d38cb2 req-c57af402-ceda-4d65-b3ca-e0897926cfec tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0301499 Sep 03 11:31:34.224961 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Request body: {'port': {'device_id': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:34.272377 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Request body: {'port': {'device_id': '2f708893-5470-4377-adde-08d9db3a42e6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:34.363616 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:34.365441 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:34.376833 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33770) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:34.725211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86ae6d49-9a30-4339-ac2f-1ccd1ec69aff admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:34.840014 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb6bb7e-d2f1-43b5-bf67-9fb7361b29fc req-41a2d5ee-c4ab-4d69-930f-3c29414d8901 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:34.841633 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9bb6bb7e-d2f1-43b5-bf67-9fb7361b29fc req-41a2d5ee-c4ab-4d69-930f-3c29414d8901 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 931 time: 0.1129036 Sep 03 11:31:34.871191 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8268fc8-248a-445c-a906-c7e44d8cc597 req-1c228377-bab4-433c-943e-24d57b57a484 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0564938 Sep 03 11:31:35.007980 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8dba3504-1d0d-4e2a-9da3-d44f9f95684d {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:35.017462 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.023778 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9bb6bb7e-d2f1-43b5-bf67-9fb7361b29fc req-9da96880-bd30-4299-95be-5cce275659b0 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1660695 Sep 03 11:31:35.055240 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Transition to ACTIVE for port object 8dba3504-1d0d-4e2a-9da3-d44f9f95684d will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:35.090121 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-e63e892e-0cf8-480a-873a-19bcf3290627 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:35.091825 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-e63e892e-0cf8-480a-873a-19bcf3290627 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.2116332 Sep 03 11:31:35.093840 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86ae6d49-9a30-4339-ac2f-1ccd1ec69aff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.119687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Request body: {'port': {'device_id': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'admin_state_up': True, 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:35.120493 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.143085 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86ae6d49-9a30-4339-ac2f-1ccd1ec69aff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.247036 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-86ae6d49-9a30-4339-ac2f-1ccd1ec69aff admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=dbde07a0315844aa8e05bcda2bc666e1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8688998 Sep 03 11:31:35.271770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33804) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:35.272032 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ae6d49-9a30-4339-ac2f-1ccd1ec69aff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07394226-182d-419c-af75-5c119c7f5491,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:35.307180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Pushing event updated for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:35.438223 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Attempting to bind port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:35.438599 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Attempting to bind port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:35.438933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Attempting to bind port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:35.449503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.450564 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:31:35.451610 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Attempting to bind port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:35.465306 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33820) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:35.479771 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.489704 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:35.490322 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Checking segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:35.497316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Bound using segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:35.497316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Bound port: 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:35.497316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.497582 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:35.500152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.511691 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1ec235e2-d042-4026-bdc2-da77b096452b {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:35.538573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.588999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:35.594347 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:35.617152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-135791580-network', 'tenant_id': 'a929f96c596b45e78449a64936959efe'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:35.646636 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Transition to ACTIVE for port object 1ec235e2-d042-4026-bdc2-da77b096452b will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:35.649371 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.653427 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.658120 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.659370 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/07394226-182d-419c-af75-5c119c7f5491 HTTP/1.1" status: 204 len: 168 time: 0.3631990 Sep 03 11:31:35.689073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:35.689073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.690121 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] 10.222.0.11 "PUT /v2.0/ports/8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 1093 time: 1.4705305 Sep 03 11:31:35.690763 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:35.693322 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-261b5624-3051-4c5d-b013-75a01a9b220f" -d '{"events": [{"name": "network-changed", "server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:35.706812 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Allocated IP 172.20.0.4 (778c15f4-3719-4d66-9e6d-1be38ac5cc42/c64b6662-4e29-47d5-96b7-4719ce1edb33/221c6012-4b26-4d7d-b7e8-145356803449) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:35.721804 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05845edc-2c9d-4ab1-92bd-962a46a45d7b service neutron] Pushing event updated for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:35.737350 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.741615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76b4129-e25e-4548-a930-76376847334c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07394226-182d-419c-af75-5c119c7f5491,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:35.750413 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8289c551-1766-45d7-82c8-f34304dc2586 x-openstack-request-id: req-8289c551-1766-45d7-82c8-f34304dc2586 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:35.751208 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:35.751457 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-8289c551-1766-45d7-82c8-f34304dc2586 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:35.751846 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d', 'status': 'completed', 'code': 200} Sep 03 11:31:35.826452 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Pushing event updated for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:35.831624 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Made reservation on behalf of a929f96c596b45e78449a64936959efe for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:35.833970 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.853182 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.893114 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261b5624-3051-4c5d-b013-75a01a9b220f req-0388d6ff-6f5e-467b-8577-c994d0871c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:35.894929 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-261b5624-3051-4c5d-b013-75a01a9b220f req-0388d6ff-6f5e-467b-8577-c994d0871c96 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1096 time: 0.1110694 Sep 03 11:31:35.947947 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Attempting to bind port 1ec235e2-d042-4026-bdc2-da77b096452b on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:35.948294 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Attempting to bind port 1ec235e2-d042-4026-bdc2-da77b096452b by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:35.948535 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Attempting to bind port 1ec235e2-d042-4026-bdc2-da77b096452b on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:35.956436 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Port 1ec235e2-d042-4026-bdc2-da77b096452b on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:31:35.956766 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Attempting to bind port 1ec235e2-d042-4026-bdc2-da77b096452b on network 29b4f20f-4a29-4a98-9a98-c60b1b87931c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:35.979566 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:35.992610 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:35.992962 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Checking segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:35.993845 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Bound using segment: {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:35.994312 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Bound port: 1ec235e2-d042-4026-bdc2-da77b096452b, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56638015-f78b-4c41-bcc1-ec6d8ef4f101', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:35.994704 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.035450 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5c6fcd48-c442-47f0-bf05-56c3af3b971a req-c560e20d-acb7-4385-b916-8c573ede28a6 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0883706 Sep 03 11:31:36.089624 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261b5624-3051-4c5d-b013-75a01a9b220f req-9719ec63-ef6b-4ea5-83de-810cdf48e2fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.091185 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-261b5624-3051-4c5d-b013-75a01a9b220f req-9719ec63-ef6b-4ea5-83de-810cdf48e2fc service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&shared=False HTTP/1.1" status: 200 len: 919 time: 0.1865907 Sep 03 11:31:36.129253 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.165594 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:36.221776 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-154e37c8-ab2f-4123-a9fc-3c7bd6d95390 req-2bb63c2e-7d59-4a79-a0c5-b53ca5abe9a8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.221985 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1ec235e2-d042-4026-bdc2-da77b096452b,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:36.226857 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-154e37c8-ab2f-4123-a9fc-3c7bd6d95390 req-2bb63c2e-7d59-4a79-a0c5-b53ca5abe9a8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 943 time: 0.0669825 Sep 03 11:31:36.251009 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261b5624-3051-4c5d-b013-75a01a9b220f req-2eb849a7-e9fc-4860-8f97-97a2a18baccf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.252420 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-261b5624-3051-4c5d-b013-75a01a9b220f req-2eb849a7-e9fc-4860-8f97-97a2a18baccf service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1511798 Sep 03 11:31:36.264390 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.272074 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.287397 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8', 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:36.312316 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-154e37c8-ab2f-4123-a9fc-3c7bd6d95390 req-3f140f17-f418-400a-bb9e-fc189f2511d1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822408 Sep 03 11:31:36.325111 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.356637 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] vlan segment allocate from pool success with {'vlan_id': 353, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:31:36.370721 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f132ebc1-0d3b-402f-888c-c905d3a1e882,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:36.373268 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33846) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:36.379322 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.379847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.381388 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] 10.222.0.11 "PUT /v2.0/ports/1ec235e2-d042-4026-bdc2-da77b096452b HTTP/1.1" status: 200 len: 1093 time: 2.1135299 Sep 03 11:31:36.384956 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:36.395148 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.395495 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Added segment c499ba7c-8196-4f0f-a2b8-db6c7f79d569 of type vlan for network f39e51e6-3ab9-4955-9302-06484ab5c362 Sep 03 11:31:36.400300 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-dd543c0f-c3eb-4f61-b618-1b680a19a429 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.401847 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-dd543c0f-c3eb-4f61-b618-1b680a19a429 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1096 time: 0.1109867 Sep 03 11:31:36.401955 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:36.410197 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:36.424370 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event updated for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:36.453405 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-f0bf5bac-d9a5-4442-8569-13a0b507ec89 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 217 time: 0.0404844 Sep 03 11:31:36.454201 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6adc12-c92d-4e7f-ac59-7c3b4ffd84ec service neutron] Pushing event updated for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:36.511776 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.560395 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.561069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.577821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1649b663-fdef-4941-b623-c0935f018f23 req-b77063d4-666f-44e3-b36a-e726a8b7608d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.577821 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-b77063d4-666f-44e3-b36a-e726a8b7608d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.1140983 Sep 03 11:31:36.580655 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33852) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:36.584447 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-efba9b45-0eb8-4488-ace7-0058c14dfc9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.587246 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-efba9b45-0eb8-4488-ace7-0058c14dfc9f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 1096 time: 0.0682464 Sep 03 11:31:36.613909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-903e64e2-b6bf-4b70-8485-f9a80b7e7c31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.618495 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-d649b4a2-50ef-4ed1-9743-1248ef7ce0d6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0292668 Sep 03 11:31:36.630223 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.660815 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-3a5048ec-5a38-48fc-86e1-492ad9203ba9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ec235e2-d042-4026-bdc2-da77b096452b HTTP/1.1" status: 200 len: 217 time: 0.0450947 Sep 03 11:31:36.663128 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.664186 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.664858 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.697268 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d21c0e69-8269-446b-913a-ad25764d673d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5841665 Sep 03 11:31:36.714056 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Request body: {'port': {'device_id': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:36.717100 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.db.api [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 03 11:31:36.717100 dv-cinder-760199-12-iscsi neutron-server[94433]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Sep 03 11:31:36.717100 dv-cinder-760199-12-iscsi neutron-server[94433]: [parameters: {'project_id_1': '8b9cbe1b344746ccad85b8d15c614575', 'expiration_1': datetime.datetime(2021, 9, 3, 11, 31, 16, 642845)}] Sep 03 11:31:36.717100 dv-cinder-760199-12-iscsi neutron-server[94433]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=94433) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 03 11:31:36.717486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG oslo_db.api [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 03 11:31:36.762093 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-4a55d292-3026-49c0-b981-bf314620ca7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:36.763495 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-4a55d292-3026-49c0-b981-bf314620ca7a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0897684 Sep 03 11:31:36.768573 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] Pushing event updated for resources: {'Network': ['ID=f39e51e6-3ab9-4955-9302-06484ab5c362,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:36.781241 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network f39e51e6-3ab9-4955-9302-06484ab5c362 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:31:36.803040 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-9fc336aa-9750-4d2b-8ca8-4cd699f0ec83 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1769037 Sep 03 11:31:36.804784 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-549745b3-c4ee-49e5-9a3b-90778df84c78 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0295968 Sep 03 11:31:36.821990 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.909657 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-903e64e2-b6bf-4b70-8485-f9a80b7e7c31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:36.978968 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-cbd35b61-5c0a-4ae2-b74a-bff5932e246d service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1601768 Sep 03 11:31:36.982399 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-a80ace23-74cc-4fdf-bec1-6294aa031c5c service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1554363 Sep 03 11:31:37.079789 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-5873b9a7-d0ad-4018-9add-2a964c1d807c req-a1d8a3cd-dd20-4804-8a5d-7ce60b186b85 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885766 Sep 03 11:31:37.219186 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.224306 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-903e64e2-b6bf-4b70-8485-f9a80b7e7c31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.317041 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-df04e743-cf0a-4887-8427-4c147431fb97 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.8506782 Sep 03 11:31:37.320339 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33870) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:37.327746 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Request body: {'subnet': {'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-135791580-subnet', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:37.330189 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-903e64e2-b6bf-4b70-8485-f9a80b7e7c31 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6fcd4666aab84dada472cf0b49508081&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7485285 Sep 03 11:31:37.334770 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33872) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:37.356413 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903e64e2-b6bf-4b70-8485-f9a80b7e7c31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88d826af-b865-4718-9023-edcfc4ceaa2c,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:37.371259 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec52b0d-ca05-46f1-bd29-e2249b42489b req-a66852c6-032f-44f7-ac52-74bf20f007d9 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:37.372816 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bec52b0d-ca05-46f1-bd29-e2249b42489b req-a66852c6-032f-44f7-ac52-74bf20f007d9 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 931 time: 0.1546032 Sep 03 11:31:37.434575 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.453774 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.511906 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 221c6012-4b26-4d7d-b7e8-145356803449 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:37.518899 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bec52b0d-ca05-46f1-bd29-e2249b42489b req-610abcf2-6af1-488d-a0b7-4e923b1d8219 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349084 Sep 03 11:31:37.525001 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.559408 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2797a373-29a3-4cf0-ac45-cf6b320b0ca9 req-fa11a245-c9b2-4a74-be06-682b1763477f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:37.560894 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2797a373-29a3-4cf0-ac45-cf6b320b0ca9 req-fa11a245-c9b2-4a74-be06-682b1763477f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 943 time: 0.1527367 Sep 03 11:31:37.583563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.600557 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.601312 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Transition to ACTIVE for port object 221c6012-4b26-4d7d-b7e8-145356803449 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:37.604317 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.605788 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/88d826af-b865-4718-9023-edcfc4ceaa2c HTTP/1.1" status: 204 len: 168 time: 0.2698877 Sep 03 11:31:37.612904 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2797a373-29a3-4cf0-ac45-cf6b320b0ca9 req-16ae2ec7-d805-4213-9c4f-a57178604e77 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457411 Sep 03 11:31:37.614892 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e80753-4335-41d4-a9c2-5d539683db22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88d826af-b865-4718-9023-edcfc4ceaa2c,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:37.698004 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.751144 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.752846 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:37.755208 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22a094ad-2faf-4363-8a37-40fc7a7456f6" -d '{"events": [{"name": "network-changed", "server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:37.792446 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8b9cbe1b344746ccad85b8d15c614575&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4125066 Sep 03 11:31:37.796514 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33894) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:37.798497 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc4b54a6-4f94-4fef-adfb-ef088f6ba3e4 x-openstack-request-id: req-bc4b54a6-4f94-4fef-adfb-ef088f6ba3e4 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:37.798788 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:37.799034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-bc4b54a6-4f94-4fef-adfb-ef088f6ba3e4 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:37.800059 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2418a91-c4e0-4f08-83d7-54c7a95f7d31 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afa43b05-0cde-4c4e-8aa8-6ab929c7d8e0,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:37.800341 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b', 'status': 'completed', 'code': 200} Sep 03 11:31:37.839661 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Made reservation on behalf of a929f96c596b45e78449a64936959efe for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:37.841913 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-260563317'] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.846660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Pushing event updated for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:37.929403 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-553f5e17-7668-499a-8bba-746b28a3c580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:37.929614 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.931370 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-553f5e17-7668-499a-8bba-746b28a3c580 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 1096 time: 0.1033001 Sep 03 11:31:37.964195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:37.970752 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Attempting to bind port 221c6012-4b26-4d7d-b7e8-145356803449 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:37.971266 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Attempting to bind port 221c6012-4b26-4d7d-b7e8-145356803449 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:37.974532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Attempting to bind port 221c6012-4b26-4d7d-b7e8-145356803449 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:37.979568 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Port 221c6012-4b26-4d7d-b7e8-145356803449 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:31:37.980070 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Attempting to bind port 221c6012-4b26-4d7d-b7e8-145356803449 on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:38.005089 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:38.005610 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Checking segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:38.006023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Bound using segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:38.006525 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Bound port: 221c6012-4b26-4d7d-b7e8-145356803449, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:38.006885 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.083887 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-6061e62b-877d-4005-addc-a9b5ae33421b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.085509 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-6061e62b-877d-4005-addc-a9b5ae33421b service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.1436293 Sep 03 11:31:38.102976 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:38.111915 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=221c6012-4b26-4d7d-b7e8-145356803449,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:38.158097 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-bb85b2ac-f9c3-4c5a-bfd9-ffdaf4ad69da service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ec235e2-d042-4026-bdc2-da77b096452b HTTP/1.1" status: 200 len: 217 time: 0.0645926 Sep 03 11:31:38.161348 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.166183 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.167931 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/afa43b05-0cde-4c4e-8aa8-6ab929c7d8e0 HTTP/1.1" status: 204 len: 168 time: 0.3688567 Sep 03 11:31:38.182206 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3dd8143-07e0-4e5d-947a-b01cc10c585d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afa43b05-0cde-4c4e-8aa8-6ab929c7d8e0,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:38.206330 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.255578 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-106afb79-2540-462c-89d6-7c54039e6c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.257394 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-106afb79-2540-462c-89d6-7c54039e6c91 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0880108 Sep 03 11:31:38.267994 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.271801 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.273468 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] 10.222.0.11 "PUT /v2.0/ports/221c6012-4b26-4d7d-b7e8-145356803449 HTTP/1.1" status: 200 len: 1093 time: 1.5676382 Sep 03 11:31:38.274288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:38.285797 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0c6807d-ddf2-4610-a60f-470134378f00" -d '{"events": [{"name": "network-changed", "server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "tag": "221c6012-4b26-4d7d-b7e8-145356803449"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:38.311337 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae520733-3e59-4653-bd95-d298dbb91765 service neutron] Pushing event updated for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:38.320434 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-e3e61294-61c7-491c-8ded-aec5b8d96e84 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0526581 Sep 03 11:31:38.335542 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2772f5d1-d42d-40be-a687-e5e4ac85debb x-openstack-request-id: req-2772f5d1-d42d-40be-a687-e5e4ac85debb {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:38.335812 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "tag": "221c6012-4b26-4d7d-b7e8-145356803449", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:38.338496 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2772f5d1-d42d-40be-a687-e5e4ac85debb {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:38.338496 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449', 'status': 'completed', 'code': 200} Sep 03 11:31:38.340750 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-260546019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-260563291'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.406958 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-f2df185c-1003-4325-9e53-e65d48087b7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.408484 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-f2df185c-1003-4325-9e53-e65d48087b7b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 1096 time: 0.0471625 Sep 03 11:31:38.416649 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe371eea-dd00-405f-8801-d52a715cf14f,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:38.471524 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Checking segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:38.471884 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Network hostable DHCP agents. Network: f39e51e6-3ab9-4955-9302-06484ab5c362, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:31:38.500988 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-5a053d78-e138-4334-8ded-11f9da419909 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1655159 Sep 03 11:31:38.612098 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Network f39e51e6-3ab9-4955-9302-06484ab5c362 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:31:38.648199 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-2ea1ae58-71a1-4017-920e-33d3f69cc512 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.651681 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-2ea1ae58-71a1-4017-920e-33d3f69cc512 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&shared=False HTTP/1.1" status: 200 len: 916 time: 0.2335408 Sep 03 11:31:38.651806 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-22a094ad-2faf-4363-8a37-40fc7a7456f6 req-fa85d4af-7f8e-42d8-97ab-e6cea915a8ba service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1345201 Sep 03 11:31:38.661738 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803ee487-f5cb-44f2-946a-19973f4fb126 req-06dd9d27-c74e-44ff-8495-2d5cd9e94876 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.663332 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-803ee487-f5cb-44f2-946a-19973f4fb126 req-06dd9d27-c74e-44ff-8495-2d5cd9e94876 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.0580487 Sep 03 11:31:38.721041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, f39e51e6-3ab9-4955-9302-06484ab5c362) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:38.729853 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.732867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:38.736669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40205c9b-e1bb-4de2-ac58-5e7d8fd9af18 None None] Network f39e51e6-3ab9-4955-9302-06484ab5c362 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:38.864034 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-eac42bfd-0140-47b6-8aa4-89bb2c0622bd admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.5358331 Sep 03 11:31:38.864034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33946) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:38.867921 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:38.915645 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-803ee487-f5cb-44f2-946a-19973f4fb126 req-666696fc-d600-4785-857f-a96e99fcfee8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2115831 Sep 03 11:31:38.938854 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d94ac6d-82d1-4c40-a515-571a3fc5790c req-74283afc-c100-4b51-bd31-bd0b0b539980 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.940701 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d94ac6d-82d1-4c40-a515-571a3fc5790c req-74283afc-c100-4b51-bd31-bd0b0b539980 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 943 time: 0.2268651 Sep 03 11:31:38.954026 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-a43c5472-5e97-4ed0-b72a-ee37a61066a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:38.955837 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e0c6807d-ddf2-4610-a60f-470134378f00 req-a43c5472-5e97-4ed0-b72a-ee37a61066a7 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2915785 Sep 03 11:31:38.996479 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d94ac6d-82d1-4c40-a515-571a3fc5790c req-9e105540-8d07-4923-b85c-028e65077db8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454178 Sep 03 11:31:39.013874 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-f39e51e6-3ab9-4955-9302-06484ab5c362', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:31:39.018817 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.035393 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.036979 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.089647 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-e260b807-4362-49b3-b01e-7949d01b587a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:39.091338 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-e260b807-4362-49b3-b01e-7949d01b587a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 1096 time: 0.0541553 Sep 03 11:31:39.094742 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.166458 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-95b2c81e-ba8a-48b0-93d2-8fd78fa3155e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=221c6012-4b26-4d7d-b7e8-145356803449 HTTP/1.1" status: 200 len: 217 time: 0.0516427 Sep 03 11:31:39.246105 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-dc8de0b0-f2f6-441d-9356-89587c5dff43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:39.247681 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-dc8de0b0-f2f6-441d-9356-89587c5dff43 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0794678 Sep 03 11:31:39.250211 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Allocated IP 172.20.0.2 (f39e51e6-3ab9-4955-9302-06484ab5c362/fe371eea-dd00-405f-8801-d52a715cf14f/a3fe56c8-8be1-4be7-809b-ef2dda0859bd) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:39.304604 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-b5c7c8c6-d6e3-4d30-90d2-4c48bbd29930 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0493155 Sep 03 11:31:39.373109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.391105 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 33958) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:39.411501 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-090e8350-24b4-4381-9d90-2851ee963cab admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.467092 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.475386 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-07c1aac3-5b97-4e9f-9ad3-71c23d198bf0 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1607206 Sep 03 11:31:39.478109 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Transition to ACTIVE for port object a3fe56c8-8be1-4be7-809b-ef2dda0859bd will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:39.506547 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Transition to ACTIVE for port object a3fe56c8-8be1-4be7-809b-ef2dda0859bd will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:39.578482 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.618320 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Network f39e51e6-3ab9-4955-9302-06484ab5c362 is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:39.621585 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:39.622073 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b9b3eda5-b6ff-4b73-a012-f80427ea452a req-d48b0875-4d40-4a51-b25c-e6bb5403a97a service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1367121 Sep 03 11:31:39.625196 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:39.631071 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-090e8350-24b4-4381-9d90-2851ee963cab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.650803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Pushing event updated for resources: {'Port': ['ID=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:39.702528 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Attempting to bind port a3fe56c8-8be1-4be7-809b-ef2dda0859bd on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:39.703052 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Attempting to bind port a3fe56c8-8be1-4be7-809b-ef2dda0859bd by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:39.703409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Attempting to bind port a3fe56c8-8be1-4be7-809b-ef2dda0859bd on network f39e51e6-3ab9-4955-9302-06484ab5c362 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:39.709383 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:39.709758 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Checking segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:39.710151 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.710565 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Bound using segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:39.711031 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Bound port: a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:39.712097 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.764688 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-090e8350-24b4-4381-9d90-2851ee963cab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.784712 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] For port a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:39.790058 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] For port a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:39.818087 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.826639 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-090e8350-24b4-4381-9d90-2851ee963cab admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9309405ef49e4bbe81a2abb9ed1d1b97&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4344742 Sep 03 11:31:39.829306 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 33966) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:39.847359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090e8350-24b4-4381-9d90-2851ee963cab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60bc2894-4f4d-4656-af3a-773fc26d6b11,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:39.850800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.889134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.899709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:39.915653 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.001643 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb21cb6-01b5-4429-bd5a-d61cecb1b43b None None] Pushing event updated for resources: {'Port': ['ID=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:40.043967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Allocated IP 172.27.0.236 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/dc1a589c-41dc-4456-9396-a689cbcdfdac) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:40.100393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.103464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.106784 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/60bc2894-4f4d-4656-af3a-773fc26d6b11 HTTP/1.1" status: 204 len: 168 time: 0.2729030 Sep 03 11:31:40.187103 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637a855c-9052-41c4-8940-2008b22476f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60bc2894-4f4d-4656-af3a-773fc26d6b11,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:40.229137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a29946e-6a97-442a-9f88-3ea9f1f1ea32 req-bbf9970a-38e5-457e-bc42-e6d48cf2e601 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:40.236844 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1a29946e-6a97-442a-9f88-3ea9f1f1ea32 req-bbf9970a-38e5-457e-bc42-e6d48cf2e601 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.1575744 Sep 03 11:31:40.249288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30fd2f96-3dda-4cab-9a0a-3f48f4bb18da req-00ecc2cf-5671-4009-a771-eda7de6ac592 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:40.252077 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30fd2f96-3dda-4cab-9a0a-3f48f4bb18da req-00ecc2cf-5671-4009-a771-eda7de6ac592 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 943 time: 0.1525993 Sep 03 11:31:40.279066 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 8dba3504-1d0d-4e2a-9da3-d44f9f95684d details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:31:40.347655 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1a29946e-6a97-442a-9f88-3ea9f1f1ea32 req-c1f6f7b7-5dff-4c20-aefb-c2992dcd881b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092269 Sep 03 11:31:40.379579 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30fd2f96-3dda-4cab-9a0a-3f48f4bb18da req-036f02da-4635-4f2d-a176-6c27ada22949 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023517 Sep 03 11:31:40.404332 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.487254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:40.505558 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'port_id': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d', 'mac_address': 'fa:16:3e:39:cf:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:31:40.544185 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.554198 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.573049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8dba3504-1d0d-4e2a-9da3-d44f9f95684d {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:40.598012 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:40.600732 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:40.611045 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:40.613554 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Pushing event updated for resources: {'Port': ['ID=dc1a589c-41dc-4456-9396-a689cbcdfdac,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:40.615795 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:40.660367 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.662076 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1ec235e2-d042-4026-bdc2-da77b096452b details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:31:40.755063 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:40.778612 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1ec235e2-d042-4026-bdc2-da77b096452b,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:40.808600 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '1ec235e2-d042-4026-bdc2-da77b096452b', 'network_id': '29b4f20f-4a29-4a98-9a98-c60b1b87931c', 'port_id': '1ec235e2-d042-4026-bdc2-da77b096452b', 'mac_address': 'fa:16:3e:fa:5a:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d8dac57-65e4-4460-baea-bbf51d76bcf1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:31:40.865948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a3fe56c8-8be1-4be7-809b-ef2dda0859bd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:40.908065 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:40.924149 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ec235e2-d042-4026-bdc2-da77b096452b {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:40.948675 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1ec235e2-d042-4026-bdc2-da77b096452b,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:41.033862 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port a3fe56c8-8be1-4be7-809b-ef2dda0859bd completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:41.064060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.120715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.135249 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:41.364620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34016) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:41.411486 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7541718-f59b-4ff4-b778-29255d8802c1 None None] Network f39e51e6-3ab9-4955-9302-06484ab5c362 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:41.509973 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9855ecda-f386-43df-8b52-8e935bc0e672 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.532380 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a086087f-ec61-44b6-bc5f-df991da01a76 req-2488b1b0-d039-4cfd-a41c-812e73e39ebf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:41.534123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a086087f-ec61-44b6-bc5f-df991da01a76 req-2488b1b0-d039-4cfd-a41c-812e73e39ebf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.0828722 Sep 03 11:31:41.601318 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Provisioning for port a3fe56c8-8be1-4be7-809b-ef2dda0859bd completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:41.620855 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Provisioning complete for port a3fe56c8-8be1-4be7-809b-ef2dda0859bd triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:41.621221 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.629539 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a086087f-ec61-44b6-bc5f-df991da01a76 req-0229f052-cf02-4cf1-8553-50c81d612da8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826452 Sep 03 11:31:41.646360 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.697396 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9855ecda-f386-43df-8b52-8e935bc0e672 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.766322 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.798047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9855ecda-f386-43df-8b52-8e935bc0e672 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.816476 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] For port a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:41.852759 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-9855ecda-f386-43df-8b52-8e935bc0e672 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=cdc60bb86e3f4aa68cd4200a3d9a24e3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4867833 Sep 03 11:31:41.855868 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34036) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:41.892233 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b5e686-83d5-469a-993c-cf0d44a1654d req-e85866b6-5147-4bb7-bec2-38de030a1d0b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:41.894915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c0b5e686-83d5-469a-993c-cf0d44a1654d req-e85866b6-5147-4bb7-bec2-38de030a1d0b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 944 time: 0.1703937 Sep 03 11:31:41.902482 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9855ecda-f386-43df-8b52-8e935bc0e672 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4062e03f-0e4c-45dd-9d32-c63cb50f8466,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:41.904117 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.930472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.934052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94432) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:31:41.965208 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:41.985902 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c0b5e686-83d5-469a-993c-cf0d44a1654d req-8ca98301-24a0-4024-b56e-c50df5825481 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685415 Sep 03 11:31:41.998437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c200b72-c3b9-487b-8aba-eab52a59979e None None] Pushing event updated for resources: {'Port': ['ID=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:42.025229 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-4765c947-a885-4f30-a020-fce39d84cdd5 None None] Provisioning complete for port a3fe56c8-8be1-4be7-809b-ef2dda0859bd triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:42.025704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4765c947-a885-4f30-a020-fce39d84cdd5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.114852 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:42.127561 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Sync routers for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:42.136214 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:42.136931 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:42.182622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.185284 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.188770 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/4062e03f-0e4c-45dd-9d32-c63cb50f8466 HTTP/1.1" status: 204 len: 168 time: 0.3297017 Sep 03 11:31:42.204012 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76e6a15-a892-45b2-825c-6ba290034d47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4062e03f-0e4c-45dd-9d32-c63cb50f8466,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:42.235123 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.236747 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-66d5f34f-0b3b-4d6b-8df5-0347640b73d0 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.3722568 Sep 03 11:31:42.239293 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34048) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:42.242791 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:42.469161 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:40Z', 'revision_number': 3, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:42.496892 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Checking router: 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:42.497482 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Updating router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f port dc1a589c-41dc-4456-9396-a689cbcdfdac binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:42.524625 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.812245 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.847045 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.856288 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a3fe56c8-8be1-4be7-809b-ef2dda0859bd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:42.862434 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Transition to ACTIVE for port object dc1a589c-41dc-4456-9396-a689cbcdfdac will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:42.863733 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f45ead3-7fba-41c8-b9a6-9f396316f987 req-fde84b71-5a38-46b1-99aa-26cf79fbeb83 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:42.872143 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8f45ead3-7fba-41c8-b9a6-9f396316f987 req-fde84b71-5a38-46b1-99aa-26cf79fbeb83 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.1159186 Sep 03 11:31:42.910957 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8f45ead3-7fba-41c8-b9a6-9f396316f987 req-1a09d92b-74fb-457d-8ed5-ae565b4961fe tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379131 Sep 03 11:31:42.915691 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port a3fe56c8-8be1-4be7-809b-ef2dda0859bd triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:42.916194 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:42.949165 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:31:42.961138 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.000213 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Allocated IP 172.20.0.1 (f39e51e6-3ab9-4955-9302-06484ab5c362/fe371eea-dd00-405f-8801-d52a715cf14f/a435a074-d9b4-4ecd-bff1-866eee3a6408) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:43.017763 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acee5fab-61ba-4273-ad1a-28d248fab26d None None] Pushing event updated for resources: {'Port': ['ID=dc1a589c-41dc-4456-9396-a689cbcdfdac,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:43.044149 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Attempting to bind port dc1a589c-41dc-4456-9396-a689cbcdfdac on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:43.044398 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Attempting to bind port dc1a589c-41dc-4456-9396-a689cbcdfdac by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:43.044873 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Attempting to bind port dc1a589c-41dc-4456-9396-a689cbcdfdac on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:43.065488 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:43.067702 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:43.068075 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.068964 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:43.069601 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Bound port: dc1a589c-41dc-4456-9396-a689cbcdfdac, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:43.070175 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.127856 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e0a8e2-d1cd-46e7-8541-395e0696e8ef req-60602caa-8e14-4e81-b23f-6ea061bb62d1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:43.129653 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8e0a8e2-d1cd-46e7-8541-395e0696e8ef req-60602caa-8e14-4e81-b23f-6ea061bb62d1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 944 time: 0.0651548 Sep 03 11:31:43.138048 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.157637 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Transition to ACTIVE for port object a435a074-d9b4-4ecd-bff1-866eee3a6408 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:43.169741 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] For port dc1a589c-41dc-4456-9396-a689cbcdfdac, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:43.174726 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] For port dc1a589c-41dc-4456-9396-a689cbcdfdac, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=dc1a589c-41dc-4456-9396-a689cbcdfdac,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:43.192854 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8e0a8e2-d1cd-46e7-8541-395e0696e8ef req-514734cb-e081-479b-85fe-522a68f3aec9 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535469 Sep 03 11:31:43.246829 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.264140 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.309440 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Network f39e51e6-3ab9-4955-9302-06484ab5c362 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:43.309796 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acee5fab-61ba-4273-ad1a-28d248fab26d None None] Pushing event updated for resources: {'Port': ['ID=dc1a589c-41dc-4456-9396-a689cbcdfdac,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:43.312677 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:43.313277 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:43.315192 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:43.320048 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:43.356077 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Pushing event updated for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:43.370063 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.444852 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:43.709138 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.737903 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.767177 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-241816b4-896b-4cca-b960-35aa3b21d769 None None] Provisioning for port a435a074-d9b4-4ecd-bff1-866eee3a6408 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:43.776336 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:40Z', 'revision_number': 3, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:43.778438 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-241816b4-896b-4cca-b960-35aa3b21d769 None None] Provisioning complete for port a435a074-d9b4-4ecd-bff1-866eee3a6408 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:43.778917 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-241816b4-896b-4cca-b960-35aa3b21d769 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.822354 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec4acb8-7064-44fc-875b-61cac02dcafa None None] The sync data for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi is: [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:40Z', 'revision_number': 3, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:43.831931 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-241816b4-896b-4cca-b960-35aa3b21d769 None None] Port a435a074-d9b4-4ecd-bff1-866eee3a6408 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:31:43.906896 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['1ec235e2-d042-4026-bdc2-da77b096452b'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:43.908889 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:43.933328 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['8dba3504-1d0d-4e2a-9da3-d44f9f95684d'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:43.967187 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:44.056011 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a7b0256-6da4-49f7-8245-cbbfbd01a7e0 req-7a7eee7b-0cfb-400e-a093-877b6394afa1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:44.058258 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4a7b0256-6da4-49f7-8245-cbbfbd01a7e0 req-7a7eee7b-0cfb-400e-a093-877b6394afa1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.0586419 Sep 03 11:31:44.066776 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:44.080091 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Pushing event updated for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:44.148542 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4a7b0256-6da4-49f7-8245-cbbfbd01a7e0 req-e84e71d1-565a-478f-8db4-7e4c6cee555f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832338 Sep 03 11:31:44.233001 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Network f39e51e6-3ab9-4955-9302-06484ab5c362 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:44.244946 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:44.395414 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d5d695-5a32-4a88-ad65-aea596e7c236 req-7f3982ae-205a-46f7-85d0-90769090dbe3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:44.405468 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43d5d695-5a32-4a88-ad65-aea596e7c236 req-7f3982ae-205a-46f7-85d0-90769090dbe3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 944 time: 0.1168168 Sep 03 11:31:44.485241 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:31:44.489329 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43d5d695-5a32-4a88-ad65-aea596e7c236 req-2b7694bf-8438-43bb-9731-aa5eda3d1bec tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827248 Sep 03 11:31:44.669314 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-fc17e124-b6ea-49f3-8d26-2753494fec64 None None] Provisioning complete for port a435a074-d9b4-4ecd-bff1-866eee3a6408 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:44.669827 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-fc17e124-b6ea-49f3-8d26-2753494fec64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:44.704727 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:44.723638 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e03e81f3-0aaa-48c6-b7b5-c3e16581cfe2 admin admin] 10.222.0.16 "PUT /v2.0/routers/0e1ef25d-6f50-4fcf-b63f-5954f4caac2f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4822216 Sep 03 11:31:44.729175 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-022b6a14-02a2-49bd-994f-cdfdb6d9c623 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/networks?tenant_id=8172f792c7e144a9ba62b98f19d1c789&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0621750 Sep 03 11:31:44.742921 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-fc17e124-b6ea-49f3-8d26-2753494fec64 None None] Port a435a074-d9b4-4ecd-bff1-866eee3a6408 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:31:44.891407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device dc1a589c-41dc-4456-9396-a689cbcdfdac up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:45.029236 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-59185326-174b-4198-a472-94118d5596ce tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:45.030749 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-59185326-174b-4198-a472-94118d5596ce tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2910249 Sep 03 11:31:45.046297 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-bcafefb1-7e38-491a-9936-99fe9b9e854e tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/quotas/8172f792c7e144a9ba62b98f19d1c789 HTTP/1.1" status: 200 len: 375 time: 0.0096886 Sep 03 11:31:45.084392 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-a0c16502-acd0-4333-bc90-c281594eb47d tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=8172f792c7e144a9ba62b98f19d1c789&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0318024 Sep 03 11:31:45.143774 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port dc1a589c-41dc-4456-9396-a689cbcdfdac completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:45.147841 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port dc1a589c-41dc-4456-9396-a689cbcdfdac triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:45.148228 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:45.230353 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:45.252181 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port dc1a589c-41dc-4456-9396-a689cbcdfdac, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=dc1a589c-41dc-4456-9396-a689cbcdfdac,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:45.266509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60846300-adaa-4cbd-ae71-329ba4c99918 req-cee8d917-b3e7-4db8-8ecb-71111467e9d9 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:45.267630 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-60846300-adaa-4cbd-ae71-329ba4c99918 req-cee8d917-b3e7-4db8-8ecb-71111467e9d9 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 943 time: 0.0518801 Sep 03 11:31:45.333809 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-60846300-adaa-4cbd-ae71-329ba4c99918 req-204db743-3b5b-48b6-9541-b5db73a9eda7 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579119 Sep 03 11:31:45.343682 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:45.395837 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8b817085-e425-4efd-8703-020650cdb169 req-145021a8-f486-47ab-a19c-bddd6b1f3c80 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0312560 Sep 03 11:31:45.417789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=dc1a589c-41dc-4456-9396-a689cbcdfdac,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:45.627964 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 221c6012-4b26-4d7d-b7e8-145356803449 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:31:45.630803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 8dba3504-1d0d-4e2a-9da3-d44f9f95684d up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:45.655979 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8be42e-83f4-4f0a-b3e9-2091b7202466 req-c6998b2f-1726-409f-9403-cc16cc209332 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:45.657631 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd8be42e-83f4-4f0a-b3e9-2091b7202466 req-c6998b2f-1726-409f-9403-cc16cc209332 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 944 time: 0.0896778 Sep 03 11:31:45.739872 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd8be42e-83f4-4f0a-b3e9-2091b7202466 req-491d313a-7fa2-42f1-a00c-f49eda6afc85 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730619 Sep 03 11:31:45.819225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.db.resource_extend [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Sep 03 11:31:45.908603 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34176) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:45.928128 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1010211996-network', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:45.928241 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=221c6012-4b26-4d7d-b7e8-145356803449,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:45.939763 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '221c6012-4b26-4d7d-b7e8-145356803449', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'port_id': '221c6012-4b26-4d7d-b7e8-145356803449', 'mac_address': 'fa:16:3e:76:a2:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c64b6662-4e29-47d5-96b7-4719ce1edb33', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:31:45.980242 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:45.982263 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:45.995851 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:45.996355 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.002676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 221c6012-4b26-4d7d-b7e8-145356803449 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:46.033407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Sync routers for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:46.051315 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=221c6012-4b26-4d7d-b7e8-145356803449,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:46.061992 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:46.062637 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:46.086689 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Made reservation on behalf of 2c2593c16b3940079fbd6cd69d8384ee for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:46.088983 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.098932 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.170199 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.205914 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.209378 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.240512 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:46.271334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.300825 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] vlan segment allocate from pool success with {'vlan_id': 386, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:31:46.303448 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:46.306508 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12eef4dc-5416-4628-a9a0-05395658806e,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:46.306667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-843e9f0e-84db-4580-bbe2-1dc8b64bf8fc" -d '{"events": [{"server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "name": "network-vif-plugged", "status": "completed", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:46.312803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:46.325622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.326060 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Added segment ba46573e-40c4-4961-924a-39b8685975d0 of type vlan for network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 Sep 03 11:31:46.327688 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:46.392961 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8942a190-b1eb-430d-8e3d-149eba86781b x-openstack-request-id: req-8942a190-b1eb-430d-8e3d-149eba86781b {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:46.393427 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "name": "network-vif-plugged", "status": "completed", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:46.393983 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-8942a190-b1eb-430d-8e3d-149eba86781b {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:46.394530 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d', 'code': 200} Sep 03 11:31:46.409341 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.446692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.448156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1ec235e2-d042-4026-bdc2-da77b096452b up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:46.483604 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['221c6012-4b26-4d7d-b7e8-145356803449'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:31:46.535464 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72d7a045-be0f-4fb2-9d7c-615bb4fbc1a9 req-00c98f7e-4f2d-407d-9a9f-ab3fb7ea74ae tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0331004 Sep 03 11:31:46.548464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed6f7ef-9f58-48d2-85df-57ebd6edf4ac req-4c85c647-f6b4-437d-9a4f-d888447c09a4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:46.550064 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4ed6f7ef-9f58-48d2-85df-57ebd6edf4ac req-4c85c647-f6b4-437d-9a4f-d888447c09a4 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 944 time: 0.1024041 Sep 03 11:31:46.555682 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.556999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:46.557777 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.615960 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:46.632369 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4ed6f7ef-9f58-48d2-85df-57ebd6edf4ac req-2ea48a3d-6c5f-4a77-9d85-26d14d18cc2a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629723 Sep 03 11:31:46.643920 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] Pushing event updated for resources: {'Network': ['ID=20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:46.657014 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:31:46.663888 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e60038c6-70bf-4147-9ce9-3c385c65a4bc admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.7532601 Sep 03 11:31:46.667236 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34196) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:46.672562 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Request body: {'subnet': {'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1010211996-subnet', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:46.748566 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 1ec235e2-d042-4026-bdc2-da77b096452b completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:46.753883 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Made reservation on behalf of 2c2593c16b3940079fbd6cd69d8384ee for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:46.755789 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-260563317'] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.765091 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 1ec235e2-d042-4026-bdc2-da77b096452b triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:46.765493 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:46.798120 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 2, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:46.841870 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Checking router: 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:46.842224 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Updating router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f port a435a074-d9b4-4ecd-bff1-866eee3a6408 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:46.893195 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device dc1a589c-41dc-4456-9396-a689cbcdfdac up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:46.931894 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.041615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.159421 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port dc1a589c-41dc-4456-9396-a689cbcdfdac triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:47.159797 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.191980 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1ec235e2-d042-4026-bdc2-da77b096452b,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:47.215942 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f1b784b-eed7-47bb-ac33-70e9499dc5c6 req-5bad0f9d-58a5-43e7-8936-a68736c86d22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:47.217565 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9f1b784b-eed7-47bb-ac33-70e9499dc5c6 req-5bad0f9d-58a5-43e7-8936-a68736c86d22 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.3849833 Sep 03 11:31:47.251963 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49d6235-6d35-4b94-97ff-366f755798e1 req-72204131-59a3-474d-80db-5ed3052977f0 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:47.253555 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e49d6235-6d35-4b94-97ff-366f755798e1 req-72204131-59a3-474d-80db-5ed3052977f0 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 944 time: 0.3148973 Sep 03 11:31:47.257661 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-260546019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-260563291'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.317840 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.322095 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9f1b784b-eed7-47bb-ac33-70e9499dc5c6 req-60fb4ff8-4b77-46fd-a583-21d293012b49 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933747 Sep 03 11:31:47.360143 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e49d6235-6d35-4b94-97ff-366f755798e1 req-c06ef109-2aec-40f4-a9cf-e78e8c693cb1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857062 Sep 03 11:31:47.399621 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c0748bec-114c-4f3f-b270-c063a7c46018,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:47.412671 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Checking segment: {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:47.413897 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Network hostable DHCP agents. Network: 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:31:47.425509 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:47.472194 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.483654 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Transition to ACTIVE for port object a435a074-d9b4-4ecd-bff1-866eee3a6408 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:47.537358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:31:47.583296 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.612265 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:47.622656 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:47.623271 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.623724 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd3fe1cd-c70a-4ae4-afe8-e2f15a972fb8 None None] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:47.638352 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a11679e4-058f-41d4-a08c-914fea357327 req-ffb0c483-92ed-4d41-a3fc-5da4c7463dab tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0321932 Sep 03 11:31:47.672376 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0b9d8b-4654-49ae-9005-ddd78619299c None None] Pushing event updated for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:47.693910 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a8fec360-e211-4e94-b773-643934589748 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0252578 Sep 03 11:31:47.696277 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34222) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:47.700756 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:47.756636 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Attempting to bind port a435a074-d9b4-4ecd-bff1-866eee3a6408 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:47.756803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Attempting to bind port a435a074-d9b4-4ecd-bff1-866eee3a6408 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:47.758214 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Attempting to bind port a435a074-d9b4-4ecd-bff1-866eee3a6408 on network f39e51e6-3ab9-4955-9302-06484ab5c362 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:47.767134 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:47.767506 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Checking segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:47.767899 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.768292 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Bound using segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:47.768763 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Bound port: a435a074-d9b4-4ecd-bff1-866eee3a6408, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:47.769140 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.777976 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.779545 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.814999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b52ec7-e9c9-40c5-a886-eabdc4e0723f req-14170d2b-5162-4f0f-91c5-295c81cdbfbe tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:47.824342 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77b52ec7-e9c9-40c5-a886-eabdc4e0723f req-14170d2b-5162-4f0f-91c5-295c81cdbfbe tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 944 time: 0.0869141 Sep 03 11:31:47.868028 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:47.881880 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77b52ec7-e9c9-40c5-a886-eabdc4e0723f req-6b92c125-c63c-4f40-be43-332e1a5766ad tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553708 Sep 03 11:31:47.919428 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34230) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:48.050241 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] For port a435a074-d9b4-4ecd-bff1-866eee3a6408, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:48.063469 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'fixed_ips': [{'subnet_id': 'c0748bec-114c-4f3f-b270-c063a7c46018'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:31:48.064310 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.072447 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] For port a435a074-d9b4-4ecd-bff1-866eee3a6408, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a435a074-d9b4-4ecd-bff1-866eee3a6408,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:48.072791 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d34e33cb-b827-4c07-bf40-d338ed400040 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.155730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.192772 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.268633 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d34e33cb-b827-4c07-bf40-d338ed400040 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.272278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Allocated IP 172.20.0.2 (20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95/c0748bec-114c-4f3f-b270-c063a7c46018/20fd8d80-792f-4393-9d37-f04a2b0fee50) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:48.280918 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:48.281704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:48.328933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d34e33cb-b827-4c07-bf40-d338ed400040 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.329112 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab0b9d8b-4654-49ae-9005-ddd78619299c None None] Pushing event updated for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:48.383381 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34e33cb-b827-4c07-bf40-d338ed400040 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b784de5-f320-4150-9556-a19935461716,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:48.394467 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34240) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:48.394758 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d34e33cb-b827-4c07-bf40-d338ed400040 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=69bcd21bea07494caa294fd8d61c4cbf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4742444 Sep 03 11:31:48.416536 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:48.419215 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d1b7ec90-8b37-4877-a72a-c39a967ba563" -d '{"events": [{"server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "name": "network-vif-plugged", "status": "completed", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:48.465904 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.511404 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6df480de-996a-48ef-aefb-858c6e86cd41 x-openstack-request-id: req-6df480de-996a-48ef-aefb-858c6e86cd41 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:48.511707 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "name": "network-vif-plugged", "status": "completed", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:48.512096 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6df480de-996a-48ef-aefb-858c6e86cd41 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:48.512543 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b', 'code': 200} Sep 03 11:31:48.518252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.528175 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:48.598640 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a3e05-d4c1-4cb3-b63f-36a9e550d3ca req-b581b3df-a2e2-4f3c-aba4-27bb98033181 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:48.600086 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-849a3e05-d4c1-4cb3-b63f-36a9e550d3ca req-b581b3df-a2e2-4f3c-aba4-27bb98033181 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1116340 Sep 03 11:31:48.650486 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-849a3e05-d4c1-4cb3-b63f-36a9e550d3ca req-e01a900c-967f-485e-9698-fd7adf42aaa3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429797 Sep 03 11:31:48.676004 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.681462 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.684062 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.685185 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3b784de5-f320-4150-9556-a19935461716 HTTP/1.1" status: 204 len: 168 time: 0.2897425 Sep 03 11:31:48.702542 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91abd867-e0e7-4b22-aab7-3c71d1f36c55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b784de5-f320-4150-9556-a19935461716,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:48.723095 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Transition to ACTIVE for port object 20fd8d80-792f-4393-9d37-f04a2b0fee50 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:48.747436 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.767609 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.782180 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6915ec87-7295-4c36-ab43-9ad9bf3e94e5 req-359fb6ba-c87d-4727-8a35-772a0070e847 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0415277 Sep 03 11:31:48.811413 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Transition to ACTIVE for port object 20fd8d80-792f-4393-9d37-f04a2b0fee50 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:48.876125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Allocated IP 172.27.0.211 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/aab5a8cf-41e7-41a3-9f51-29c9da9fae99) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:48.883962 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:48Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:48.910557 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:48.914272 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c3ee183-26e5-4699-95da-c89878c8b594 None None] The sync data for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi is: [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:48Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:48.956415 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:48.959495 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:48.963019 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:49.031410 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Pushing event updated for resources: {'Port': ['ID=20fd8d80-792f-4393-9d37-f04a2b0fee50,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:49.044303 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Attempting to bind port 20fd8d80-792f-4393-9d37-f04a2b0fee50 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:49.044676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Attempting to bind port 20fd8d80-792f-4393-9d37-f04a2b0fee50 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:49.045036 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Attempting to bind port 20fd8d80-792f-4393-9d37-f04a2b0fee50 on network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:49.071915 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:49.072758 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Checking segment: {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:49.073375 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.073978 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Bound using segment: {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:49.074701 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Bound port: 20fd8d80-792f-4393-9d37-f04a2b0fee50, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:49.075339 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.082652 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.092246 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8775a72-9c61-4e3a-b39b-449982260e72 req-343a5fe0-5a2c-4375-9e85-83d5e2bfb77c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:49.101757 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c8775a72-9c61-4e3a-b39b-449982260e72 req-343a5fe0-5a2c-4375-9e85-83d5e2bfb77c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 944 time: 0.0709252 Sep 03 11:31:49.159035 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c8775a72-9c61-4e3a-b39b-449982260e72 req-e518b162-413c-4cd7-bd98-5832ea5ba456 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561838 Sep 03 11:31:49.218709 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.222277 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] For port 20fd8d80-792f-4393-9d37-f04a2b0fee50, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:49.226449 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] For port 20fd8d80-792f-4393-9d37-f04a2b0fee50, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=20fd8d80-792f-4393-9d37-f04a2b0fee50,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:49.265068 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:49.268277 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:49.272710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:49.286676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.332992 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Pushing event updated for resources: {'Port': ['ID=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:49.351575 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-109547c1-f2c0-416b-bc70-8b4df92e2b4b None None] Pushing event updated for resources: {'Port': ['ID=20fd8d80-792f-4393-9d37-f04a2b0fee50,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:49.704672 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:49.784548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc00d65d-8908-4638-98eb-3d5dd9965a26 req-70243681-f683-45ac-a2cb-3b86f025f7e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:49.786008 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dc00d65d-8908-4638-98eb-3d5dd9965a26 req-70243681-f683-45ac-a2cb-3b86f025f7e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0516596 Sep 03 11:31:49.853188 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dc00d65d-8908-4638-98eb-3d5dd9965a26 req-a60b74f0-1b21-49dd-9133-ac90d2ec4fa8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572863 Sep 03 11:31:49.899642 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a020072b-1365-4e0c-9f55-76d9e3744a12 req-bac085ea-ace3-49c5-ad7a-3191db33e550 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0342944 Sep 03 11:31:49.952990 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:50.200488 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94432) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:31:50.381830 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:50.391001 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2ae1ed-5b7e-4d51-a36e-4c8524e7b512 req-7cceed26-2e1a-45c1-b816-446f6eb924c3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:50.400177 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Sync routers for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:50.402041 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d2ae1ed-5b7e-4d51-a36e-4c8524e7b512 req-7cceed26-2e1a-45c1-b816-446f6eb924c3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 944 time: 0.1026809 Sep 03 11:31:50.410843 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:50.412722 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:50.446039 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d2ae1ed-5b7e-4d51-a36e-4c8524e7b512 req-75d167a6-fab1-4284-8751-f9699eef1850 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430920 Sep 03 11:31:50.475869 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:50.478506 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8cde9383-5985-4f12-a581-babbd706738e admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.7812245 Sep 03 11:31:50.482892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34296) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:50.501006 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12237fcb-3ab9-4311-90a3-ca7ffed86aa0 None None] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:31:50.577214 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:50.622290 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9b1428-0447-4cde-8140-6afdb6fe38ce req-992db1c6-b8b5-499e-bdbe-2e6a3b27ab82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:50.624110 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b9b1428-0447-4cde-8140-6afdb6fe38ce req-992db1c6-b8b5-499e-bdbe-2e6a3b27ab82 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 1098 time: 0.1040349 Sep 03 11:31:50.697070 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-87cd42cb-f667-4420-8524-52a1c9995007 None None] Provisioning for port 20fd8d80-792f-4393-9d37-f04a2b0fee50 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:50.720314 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4d6fcbf6-8428-49de-9f05-696b77160cc7 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=8172f792c7e144a9ba62b98f19d1c789&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0516808 Sep 03 11:31:50.809209 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b9b1428-0447-4cde-8140-6afdb6fe38ce req-7e76e906-b06a-4ed5-84dd-9541208f1ed5 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1718364 Sep 03 11:31:50.917402 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:49Z', 'revision_number': 3, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:51.009025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a435a074-d9b4-4ecd-bff1-866eee3a6408 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:51.016358 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Checking router: e1b214ac-b2cb-4ef0-9765-26d72e898bb5 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:51.016944 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Updating router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:51.054958 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.181251 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-48427760-bbd3-4449-87d3-108cd9806aa0 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:51.187117 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-48427760-bbd3-4449-87d3-108cd9806aa0 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4573967 Sep 03 11:31:51.204303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Request body: {'port': {'device_id': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c', 'admin_state_up': True, 'tenant_id': '8172f792c7e144a9ba62b98f19d1c789'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:51.288190 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port a435a074-d9b4-4ecd-bff1-866eee3a6408 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:51.292798 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-834eb23e-78c0-4d97-bd3e-c01650e45706 req-cdfdf49c-f1a1-4958-ad80-d7ddab84b168 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:51.294282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port a435a074-d9b4-4ecd-bff1-866eee3a6408 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:51.295003 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.298539 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-834eb23e-78c0-4d97-bd3e-c01650e45706 req-cdfdf49c-f1a1-4958-ad80-d7ddab84b168 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.3084905 Sep 03 11:31:51.300599 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a51bbe26-06de-4084-abdc-dec48fd61894 req-d7d44bac-03be-4eda-9541-434d3818ad80 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.1287541 Sep 03 11:31:51.434127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.439556 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-834eb23e-78c0-4d97-bd3e-c01650e45706 req-e656c711-b8c5-41a4-8ea6-e904417a54c7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1332221 Sep 03 11:31:51.472378 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port a435a074-d9b4-4ecd-bff1-866eee3a6408, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a435a074-d9b4-4ecd-bff1-866eee3a6408,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:51.537412 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Made reservation on behalf of 8172f792c7e144a9ba62b98f19d1c789 for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:31:51.537974 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.540693 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 20fd8d80-792f-4393-9d37-f04a2b0fee50 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:51.542939 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.563237 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.585181 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.604601 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Transition to ACTIVE for port object aab5a8cf-41e7-41a3-9f51-29c9da9fae99 will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:51.645904 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:51.705996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.707365 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 221c6012-4b26-4d7d-b7e8-145356803449 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:51.724051 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96a3beb-0236-43a6-955c-50c037f5fc49 req-b5ec1132-348b-4ca9-9d7e-6be6e17137fc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:51.725535 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f96a3beb-0236-43a6-955c-50c037f5fc49 req-b5ec1132-348b-4ca9-9d7e-6be6e17137fc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 944 time: 0.1282005 Sep 03 11:31:51.750775 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.789186 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f96a3beb-0236-43a6-955c-50c037f5fc49 req-a4552a66-c6a8-499b-8c63-a1ac7c579fe2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572126 Sep 03 11:31:51.817851 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.846840 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.847245 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 20fd8d80-792f-4393-9d37-f04a2b0fee50 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:51.849340 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 221c6012-4b26-4d7d-b7e8-145356803449 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:51.860318 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 221c6012-4b26-4d7d-b7e8-145356803449 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:51.861653 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.879611 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270e5d7b-799b-4601-932b-c5769d4acd18 None None] Pushing event updated for resources: {'Port': ['ID=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:51.885451 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Attempting to bind port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:51.885899 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Attempting to bind port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:51.886354 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Attempting to bind port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:51.892965 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:51.893452 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:51.894848 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.895323 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:51.897340 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Bound port: aab5a8cf-41e7-41a3-9f51-29c9da9fae99, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:51.897894 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.922807 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 20fd8d80-792f-4393-9d37-f04a2b0fee50 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:51.923315 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:51.944078 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f474df08-b0fd-4b3d-8124-4308d8d1e193,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:51.956665 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Allocated IP 172.20.0.1 (20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95/c0748bec-114c-4f3f-b270-c063a7c46018/326f79cc-141e-458a-90e2-e269ba7aae4a) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:51.979659 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] For port aab5a8cf-41e7-41a3-9f51-29c9da9fae99, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:51.986502 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] For port aab5a8cf-41e7-41a3-9f51-29c9da9fae99, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:52.050482 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.051864 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Allocated IP 192.168.233.79 (aca5ae01-5c6f-4607-8a45-d689affa9a6c/900851b5-cacf-47af-aee5-848c49e99979/368ea95a-ef61-469d-80b4-d3fb48c24275) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:31:52.071151 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.077569 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.091708 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:52.093978 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b263d6c6-c93b-4804-a74a-f48369e6f2b0" -d '{"events": [{"server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "name": "network-vif-plugged", "status": "completed", "tag": "221c6012-4b26-4d7d-b7e8-145356803449"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:52.097054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Transition to ACTIVE for port object 326f79cc-141e-458a-90e2-e269ba7aae4a will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:52.126919 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=221c6012-4b26-4d7d-b7e8-145356803449,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:52.140740 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.143872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 20fd8d80-792f-4393-9d37-f04a2b0fee50, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=20fd8d80-792f-4393-9d37-f04a2b0fee50,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:52.153706 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c53cce6-be7b-474f-9638-b40adb409dff x-openstack-request-id: req-0c53cce6-be7b-474f-9638-b40adb409dff {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:52.154042 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "name": "network-vif-plugged", "status": "completed", "tag": "221c6012-4b26-4d7d-b7e8-145356803449", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:52.154254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0c53cce6-be7b-474f-9638-b40adb409dff {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:52.154692 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449', 'code': 200} Sep 03 11:31:52.224723 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:52.225247 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:52.228864 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.233274 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270e5d7b-799b-4601-932b-c5769d4acd18 None None] Pushing event updated for resources: {'Port': ['ID=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:52.284839 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:52.292864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.302782 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.313876 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.376578 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Transition to ACTIVE for port object 368ea95a-ef61-469d-80b4-d3fb48c24275 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:52.405595 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:52.411606 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:52.427127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=20fd8d80-792f-4393-9d37-f04a2b0fee50,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:52.431985 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:52.447820 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:52.452187 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Pushing event updated for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:52.515555 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.523843 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0302a905-9bed-4199-a195-fdd52d25e777 req-19176961-69ab-4109-8942-42e0b9f6d339 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.1007762 Sep 03 11:31:52.597472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Network aca5ae01-5c6f-4607-8a45-d689affa9a6c is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:52.600854 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:52.605525 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:31:52.728991 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:52.729680 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.752561 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Pushing event updated for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:52.763554 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb3b3af-1a3a-40c5-83e0-3ef5dab5f229 req-2e9ef63b-4e56-4256-bc78-c85337371fff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:52.765218 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3eb3b3af-1a3a-40c5-83e0-3ef5dab5f229 req-2e9ef63b-4e56-4256-bc78-c85337371fff service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 1098 time: 0.2532074 Sep 03 11:31:52.771467 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:52.803104 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:49Z', 'revision_number': 3, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:52.841028 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-771c53c8-a0b8-49fd-980e-72532ef29d77 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.6413090 Sep 03 11:31:52.847074 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a435a074-d9b4-4ecd-bff1-866eee3a6408 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:52.852236 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2120819-74b4-46ef-98bd-0fe8dc2887b3 None None] The sync data for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi is: [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:49Z', 'revision_number': 3, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:52.855421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Request body: {'port': {'device_id': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:31:52.993006 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port a435a074-d9b4-4ecd-bff1-866eee3a6408 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:52.993553 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.013546 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.049687 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-f46b5dd4-e106-4abe-81cb-e0d8391718cf None None] Provisioning for port 326f79cc-141e-458a-90e2-e269ba7aae4a completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:53.057597 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-f46b5dd4-e106-4abe-81cb-e0d8391718cf None None] Provisioning complete for port 326f79cc-141e-458a-90e2-e269ba7aae4a triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:53.058119 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-f46b5dd4-e106-4abe-81cb-e0d8391718cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.156860 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-f46b5dd4-e106-4abe-81cb-e0d8391718cf None None] Port 326f79cc-141e-458a-90e2-e269ba7aae4a cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:31:53.159796 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ade862c-0881-47b6-8891-196626d38449 req-e8d3c771-1938-43eb-ae73-6dd3670c26ce tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:53.175244 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ade862c-0881-47b6-8891-196626d38449 req-e8d3c771-1938-43eb-ae73-6dd3670c26ce tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.5409529 Sep 03 11:31:53.186159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3eb3b3af-1a3a-40c5-83e0-3ef5dab5f229 req-21fe8082-4438-4b79-b7e7-a92a5a5c526e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3799770 Sep 03 11:31:53.253089 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 20fd8d80-792f-4393-9d37-f04a2b0fee50 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:53.261507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.355469 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 20fd8d80-792f-4393-9d37-f04a2b0fee50 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:53.355846 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.356264 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ade862c-0881-47b6-8891-196626d38449 req-1c7ed186-ab3d-4c26-9bbb-07f6268d80d6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1771390 Sep 03 11:31:53.440672 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-a779ce3d-5f67-4496-a9cf-0ed0a5ca39dd None None] Provisioning for port 368ea95a-ef61-469d-80b4-d3fb48c24275 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:53.459401 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-a779ce3d-5f67-4496-a9cf-0ed0a5ca39dd None None] Provisioning complete for port 368ea95a-ef61-469d-80b4-d3fb48c24275 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:53.459886 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a779ce3d-5f67-4496-a9cf-0ed0a5ca39dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.514948 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3eac157-16dc-4ad4-a2b7-239f80e940f7 req-4ec0d842-bdbd-4be1-b884-93c5a4eaba36 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:53.526507 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d3eac157-16dc-4ad4-a2b7-239f80e940f7 req-4ec0d842-bdbd-4be1-b884-93c5a4eaba36 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.2816913 Sep 03 11:31:53.645872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 368ea95a-ef61-469d-80b4-d3fb48c24275 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:31:53.661022 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.684481 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d3eac157-16dc-4ad4-a2b7-239f80e940f7 req-7cc8bd88-a23e-4403-aa2c-eda20683ea40 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1483216 Sep 03 11:31:53.684597 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Transition to ACTIVE for port object 368ea95a-ef61-469d-80b4-d3fb48c24275 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:53.705812 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf59373-5719-45e3-9ffa-4e8eaf970a78 req-ae64117d-3897-48ff-ac9a-18e4d5a3b0fd tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:53.707756 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cf59373-5719-45e3-9ffa-4e8eaf970a78 req-ae64117d-3897-48ff-ac9a-18e4d5a3b0fd tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1755927 Sep 03 11:31:53.764118 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-a779ce3d-5f67-4496-a9cf-0ed0a5ca39dd None None] Port 368ea95a-ef61-469d-80b4-d3fb48c24275 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:31:53.764766 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.777496 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cf59373-5719-45e3-9ffa-4e8eaf970a78 req-0686f9e8-8c68-409e-b40b-4a2966b98515 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601492 Sep 03 11:31:53.807604 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.875205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.876359 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-80626062-3e49-48e8-b69a-52aa96a95360 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:53.981987 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34388) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:53.985638 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Attempting to bind port 368ea95a-ef61-469d-80b4-d3fb48c24275 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:53.985638 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Attempting to bind port 368ea95a-ef61-469d-80b4-d3fb48c24275 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:53.986039 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Attempting to bind port 368ea95a-ef61-469d-80b4-d3fb48c24275 on network aca5ae01-5c6f-4607-8a45-d689affa9a6c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:54.004552 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Pushing event updated for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:54.016422 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Port 368ea95a-ef61-469d-80b4-d3fb48c24275 on network aca5ae01-5c6f-4607-8a45-d689affa9a6c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:31:54.016937 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Attempting to bind port 368ea95a-ef61-469d-80b4-d3fb48c24275 on network aca5ae01-5c6f-4607-8a45-d689affa9a6c {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:54.023867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:54.024488 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Checking segment: {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:54.025074 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Bound using segment: {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:54.025821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Bound port: 368ea95a-ef61-469d-80b4-d3fb48c24275, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6ed52ab9-b39d-44c8-aab2-33332f5ea8fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:54.027258 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.033232 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.036130 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Pushing event updated for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:54.062661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-395ec085-3a94-4d8d-a79e-6ca1c485e139 req-664969c9-c2be-4170-9502-40f26fc76161 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.064227 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-395ec085-3a94-4d8d-a79e-6ca1c485e139 req-664969c9-c2be-4170-9502-40f26fc76161 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 947 time: 0.1407304 Sep 03 11:31:54.112840 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:54.117631 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=368ea95a-ef61-469d-80b4-d3fb48c24275,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:54.161586 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b224a70-841b-48fa-b854-710e2d426b9f admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.166106 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-395ec085-3a94-4d8d-a79e-6ca1c485e139 req-1e6f8491-9fbd-49fe-a871-9d3f0f8525db tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827160 Sep 03 11:31:54.211875 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:31:54.213592 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:31:54.260153 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.346129 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.346993 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.348729 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] 10.222.0.11 "PUT /v2.0/ports/368ea95a-ef61-469d-80b4-d3fb48c24275 HTTP/1.1" status: 200 len: 1097 time: 1.4990091 Sep 03 11:31:54.355627 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:31:54.359302 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:31:54.359441 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-864211dd-c045-450d-8e36-c693902c5a89" -d '{"events": [{"name": "network-changed", "server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:31:54.393043 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b224a70-841b-48fa-b854-710e2d426b9f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.428935 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:31:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b55d8813-1740-448f-810e-3ea98b37a41b x-openstack-request-id: req-b55d8813-1740-448f-810e-3ea98b37a41b {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:31:54.429790 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:31:54.430039 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b55d8813-1740-448f-810e-3ea98b37a41b {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:31:54.430449 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275', 'status': 'completed', 'code': 200} Sep 03 11:31:54.492712 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df17f67-7c2c-48fd-ac8c-aea38d4c5bb8 service neutron] Pushing event updated for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:54.526580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b224a70-841b-48fa-b854-710e2d426b9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.572566 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-5b224a70-841b-48fa-b854-710e2d426b9f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=1180ddb72db54b46a5866c359ab30131&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5816140 Sep 03 11:31:54.573431 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34404) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:54.622237 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e74283-6998-40bf-bc06-cbd1a2bd2ecd req-fd2a0409-7ec3-47d3-99b8-be74ef60c19f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.629124 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46e74283-6998-40bf-bc06-cbd1a2bd2ecd req-fd2a0409-7ec3-47d3-99b8-be74ef60c19f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.2630377 Sep 03 11:31:54.655595 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864211dd-c045-450d-8e36-c693902c5a89 req-8517188c-0136-4e04-bcfc-7e6ca50aecce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.657076 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-864211dd-c045-450d-8e36-c693902c5a89 req-8517188c-0136-4e04-bcfc-7e6ca50aecce service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8172f792c7e144a9ba62b98f19d1c789&device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 1100 time: 0.1548522 Sep 03 11:31:54.666920 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.694357 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.721523 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-864211dd-c045-450d-8e36-c693902c5a89 req-f8a3ce98-33ed-4658-aa4e-c6ec3eefcfe6 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=8172f792c7e144a9ba62b98f19d1c789&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0539410 Sep 03 11:31:54.729492 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-10d53ce5-fd96-421a-9ffd-559d572f2202 None None] Provisioning complete for port 326f79cc-141e-458a-90e2-e269ba7aae4a triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:54.729873 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-10d53ce5-fd96-421a-9ffd-559d572f2202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:54.733037 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-a64928e1-7292-4f57-8522-39f227ab5e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.735645 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-a64928e1-7292-4f57-8522-39f227ab5e3f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 1098 time: 0.3042521 Sep 03 11:31:54.784101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-10d53ce5-fd96-421a-9ffd-559d572f2202 None None] Port 326f79cc-141e-458a-90e2-e269ba7aae4a cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:31:54.861644 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device aab5a8cf-41e7-41a3-9f51-29c9da9fae99 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:54.862861 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b224a70-841b-48fa-b854-710e2d426b9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87807e64-1946-4ec3-9934-9d8a5322c8b1,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:54.865095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:31:54.897784 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-93280f88-21e7-414a-ab75-38a097d17fe0 admin admin] 10.222.0.16 "PUT /v2.0/routers/e1b214ac-b2cb-4ef0-9765-26d72e898bb5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4136972 Sep 03 11:31:54.941694 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-7784f094-d08f-4324-9e64-2c5102a7ab07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.943258 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46e74283-6998-40bf-bc06-cbd1a2bd2ecd req-d7240326-27c3-4f7b-8e17-a9fb78c005f8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2982917 Sep 03 11:31:54.943811 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-7784f094-d08f-4324-9e64-2c5102a7ab07 service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.1807191 Sep 03 11:31:54.978606 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315f6bda-6759-4318-b87e-f5b3cf548ff6 req-498d4191-fe3f-4126-9f6d-ca0b1f1d23c5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:54.981141 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-315f6bda-6759-4318-b87e-f5b3cf548ff6 req-498d4191-fe3f-4126-9f6d-ca0b1f1d23c5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.1903896 Sep 03 11:31:55.017170 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-0700da6b-f8e2-4259-841d-4888a8cafbff service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1ec235e2-d042-4026-bdc2-da77b096452b HTTP/1.1" status: 200 len: 217 time: 0.0537050 Sep 03 11:31:55.027896 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864211dd-c045-450d-8e36-c693902c5a89 req-3ceffe6d-10e3-481e-a130-86e0ab200141 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.029317 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-864211dd-c045-450d-8e36-c693902c5a89 req-3ceffe6d-10e3-481e-a130-86e0ab200141 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2850323 Sep 03 11:31:55.057632 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:31:55.062884 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:55.063481 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.077968 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.081399 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.085267 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/87807e64-1946-4ec3-9934-9d8a5322c8b1 HTTP/1.1" status: 204 len: 168 time: 0.5113592 Sep 03 11:31:55.098673 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b11d2f-3d6a-46f2-88ec-540877936722 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87807e64-1946-4ec3-9934-9d8a5322c8b1,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:55.121933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-9818d37d-18a5-49ae-8d34-87689a4b1103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.124340 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-9818d37d-18a5-49ae-8d34-87689a4b1103 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.1050949 Sep 03 11:31:55.168573 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-78159a10-f900-4b57-89ff-0ea03a58e7a6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0341120 Sep 03 11:31:55.205937 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.232536 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port aab5a8cf-41e7-41a3-9f51-29c9da9fae99, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:55.284980 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-95b1f482-5958-4241-85f0-fba05dfefa15 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077166 Sep 03 11:31:55.297809 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.362447 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:55.394938 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b1878cbd-5ebb-4673-bd63-a9d7de4ff97b req-acee0242-a193-4bd5-acd9-aae8646eeeba service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1003516 Sep 03 11:31:55.412032 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-315f6bda-6759-4318-b87e-f5b3cf548ff6 req-0a925dd8-9e9b-4492-af20-e57dce4b33ae tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4219391 Sep 03 11:31:55.449481 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-67b4b7e8-c9e0-49f9-bbe2-372ceabe23d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.451696 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-67b4b7e8-c9e0-49f9-bbe2-372ceabe23d0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8172f792c7e144a9ba62b98f19d1c789&device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 1100 time: 0.0963421 Sep 03 11:31:55.466152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45c5f84-3d96-4a18-a55d-f5a7a9db6daf req-a6c165ab-53cb-4f5e-b83f-28ddee3ea1ba tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.466152 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b45c5f84-3d96-4a18-a55d-f5a7a9db6daf req-a6c165ab-53cb-4f5e-b83f-28ddee3ea1ba tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.4318490 Sep 03 11:31:55.520637 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-d2529f51-60f8-4a53-a1d6-b2870abdd66b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.79&port_id=368ea95a-ef61-469d-80b4-d3fb48c24275 HTTP/1.1" status: 200 len: 217 time: 0.0575151 Sep 03 11:31:55.608591 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b45c5f84-3d96-4a18-a55d-f5a7a9db6daf req-17398442-7114-4d39-b702-6ec7d973db3e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1391385 Sep 03 11:31:55.666674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d160e9b5-d1cf-4556-9abc-2b44e20e98f6 req-aafa5683-f312-4829-a677-564667a7a7d7 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.668347 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d160e9b5-d1cf-4556-9abc-2b44e20e98f6 req-aafa5683-f312-4829-a677-564667a7a7d7 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 947 time: 0.1634557 Sep 03 11:31:55.670556 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-12698bfd-6a85-4028-808b-23197224e6a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.672035 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-12698bfd-6a85-4028-808b-23197224e6a6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=900851b5-cacf-47af-aee5-848c49e99979 HTTP/1.1" status: 200 len: 843 time: 0.1432509 Sep 03 11:31:55.752138 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34450) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:55.766355 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d160e9b5-d1cf-4556-9abc-2b44e20e98f6 req-69caf19f-3bd4-4008-bb96-f11546b721aa tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853639 Sep 03 11:31:55.798312 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-9c19b931-dab3-4dd1-aa7b-cfc186b2f534 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:55.799993 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-9c19b931-dab3-4dd1-aa7b-cfc186b2f534 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=aca5ae01-5c6f-4607-8a45-d689affa9a6c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.1169639 Sep 03 11:31:55.902032 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56aaeb16-1bba-4973-a6cc-fcb75ed20a48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:55.910800 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-aa0bcfcd-66a7-4363-a1bb-c61e4e67d8a9 service neutron] 10.222.0.11 "GET /v2.0/networks/aca5ae01-5c6f-4607-8a45-d689affa9a6c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0947473 Sep 03 11:31:56.017877 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56aaeb16-1bba-4973-a6cc-fcb75ed20a48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.052399 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc64801a-c17e-4bad-bac0-44e20c292056 req-fdd3abf2-662b-4fad-9399-fd8e3f763de4 service neutron] 10.222.0.11 "GET /v2.0/networks/aca5ae01-5c6f-4607-8a45-d689affa9a6c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1313369 Sep 03 11:31:56.097933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56aaeb16-1bba-4973-a6cc-fcb75ed20a48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.106260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79be639d-8370-4196-bc70-52c7381b821c req-78188487-a52e-4b8d-8b8d-9c216dd685fe tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:56.107828 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79be639d-8370-4196-bc70-52c7381b821c req-78188487-a52e-4b8d-8b8d-9c216dd685fe tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0539441 Sep 03 11:31:56.141846 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56aaeb16-1bba-4973-a6cc-fcb75ed20a48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6c99bae-2440-4515-af98-e2b43930ec6d,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:56.154472 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79be639d-8370-4196-bc70-52c7381b821c req-3f97b0a2-abda-4eb3-a381-b05792fb551d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336831 Sep 03 11:31:56.154472 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34466) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:56.154888 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-56aaeb16-1bba-4973-a6cc-fcb75ed20a48 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=9aa1616429804e52a4136cf77593d3be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3993556 Sep 03 11:31:56.205218 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Sync routers for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:31:56.312662 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:56.312662 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:56.313463 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.313463 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.340631 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:56.390266 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-295d21bd-da22-45c7-b7b4-dd78ea8ae697 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.394911 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.398496 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.402567 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a6c99bae-2440-4515-af98-e2b43930ec6d HTTP/1.1" status: 204 len: 168 time: 0.2469010 Sep 03 11:31:56.411477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58ccda3-ea7e-46a4-b5d3-4488c5acc31f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6c99bae-2440-4515-af98-e2b43930ec6d,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:56.589087 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4dc852-c54e-4052-a93a-3b07cb85107d req-1c8ec894-e431-475b-b1c0-33fc660f5217 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:56.597164 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:53Z', 'revision_number': 4, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '326f79cc-141e-458a-90e2-e269ba7aae4a', 'name': '', 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'mac_address': 'fa:16:3e:d1:2c:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:51Z', 'updated_at': '2021-09-03T11:31:53Z', 'revision_number': 2, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'subnets': [{'id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:56.601078 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6a4dc852-c54e-4052-a93a-3b07cb85107d req-1c8ec894-e431-475b-b1c0-33fc660f5217 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.0794039 Sep 03 11:31:56.629016 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Checking router: e1b214ac-b2cb-4ef0-9765-26d72e898bb5 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:31:56.629532 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Updating router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 port 326f79cc-141e-458a-90e2-e269ba7aae4a binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:31:56.669900 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6a4dc852-c54e-4052-a93a-3b07cb85107d req-e048d122-b542-45c2-a797-b7a6415e1a78 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659568 Sep 03 11:31:56.670025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.749008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:56.921400 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device aab5a8cf-41e7-41a3-9f51-29c9da9fae99 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:31:57.031106 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf393413-b53a-46cb-a477-703721633c6c req-1e822ab1-9030-454c-9fcb-e010d6edfb7a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:57.040123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cf393413-b53a-46cb-a477-703721633c6c req-1e822ab1-9030-454c-9fcb-e010d6edfb7a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1194465 Sep 03 11:31:57.052995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf126776-c31a-40ed-856a-313d7bb961b2 req-ee5c9ee7-779c-44af-b043-768f8adaeb33 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:57.061464 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf126776-c31a-40ed-856a-313d7bb961b2 req-ee5c9ee7-779c-44af-b043-768f8adaeb33 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 947 time: 0.1328490 Sep 03 11:31:57.135710 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:31:57.137232 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.164974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cf393413-b53a-46cb-a477-703721633c6c req-c8c3b72a-19f3-4f4d-bf5b-71ce9ea15eda tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1187282 Sep 03 11:31:57.187632 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf126776-c31a-40ed-856a-313d7bb961b2 req-fadce4cd-ac70-4a31-afc6-5f0b7205493c tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1147797 Sep 03 11:31:57.339980 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.353993 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5877ffb3-2664-4082-973c-4f4c052650e6 req-5f678ab0-2048-4d22-a936-91a0260b0e68 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:57.365930 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Transition to ACTIVE for port object 326f79cc-141e-458a-90e2-e269ba7aae4a will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:31:57.367028 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5877ffb3-2664-4082-973c-4f4c052650e6 req-5f678ab0-2048-4d22-a936-91a0260b0e68 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1014748 Sep 03 11:31:57.425034 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5877ffb3-2664-4082-973c-4f4c052650e6 req-409f2166-5597-428c-9fdf-ac8fa09b7459 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566597 Sep 03 11:31:57.485217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.527849 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34534) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:57.563058 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.673414 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7257b08-cd29-4710-baeb-982ce7899e1e None None] Pushing event updated for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:57.701113 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.767892 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Attempting to bind port 326f79cc-141e-458a-90e2-e269ba7aae4a on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:31:57.770674 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Attempting to bind port 326f79cc-141e-458a-90e2-e269ba7aae4a by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:31:57.770674 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Attempting to bind port 326f79cc-141e-458a-90e2-e269ba7aae4a on network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:31:57.780714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 31, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:31:57.783799 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Checking segment: {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:31:57.784624 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.785347 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Bound using segment: {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:31:57.786282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Bound port: 326f79cc-141e-458a-90e2-e269ba7aae4a, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba46573e-40c4-4961-924a-39b8685975d0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:31:57.787721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.830708 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.922808 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] For port 326f79cc-141e-458a-90e2-e269ba7aae4a, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:31:57.926529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:57.937247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] For port 326f79cc-141e-458a-90e2-e269ba7aae4a, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=326f79cc-141e-458a-90e2-e269ba7aae4a,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:31:57.990814 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f881cd44b8de476a960d66aa5287de49&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4491494 Sep 03 11:31:57.990814 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc400b0e-0804-4229-99a5-0b4a29fbbe2b,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:57.990977 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34548) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:31:57.991438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.991438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.991438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.992533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.992533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.992708 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.993143 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.993407 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.993942 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.996472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.996472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:57.996472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0eea80a0-d06f-41bb-9a0a-c7422d316e12 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.067275 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:58.090167 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:58.093743 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:58.162367 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:31:58.163109 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:31:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:58.409174 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7257b08-cd29-4710-baeb-982ce7899e1e None None] Pushing event updated for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:58.473074 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:58.476237 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:58.477390 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fc400b0e-0804-4229-99a5-0b4a29fbbe2b HTTP/1.1" status: 204 len: 168 time: 0.4941263 Sep 03 11:31:58.488072 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:31:58.550516 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc400b0e-0804-4229-99a5-0b4a29fbbe2b,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:31:58.572795 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.573746 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.584303 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.584870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.585443 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.587189 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.587736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.588894 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.589974 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.590566 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.593761 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.594304 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6be9f05e-580f-4a5b-b5ef-bcfbee2af679 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:31:58.633693 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542ceaf7-c1d0-42db-95d6-ecd331b65f6b req-366f8b9e-710b-4011-be56-786dade803c5 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:58.641123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-542ceaf7-c1d0-42db-95d6-ecd331b65f6b req-366f8b9e-710b-4011-be56-786dade803c5 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 947 time: 0.3043258 Sep 03 11:31:58.718091 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56418054-1799-4812-9332-253558ca19ef req-a9cf3b10-a874-4735-866d-747c38dd86e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:58.722910 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-56418054-1799-4812-9332-253558ca19ef req-a9cf3b10-a874-4735-866d-747c38dd86e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.3192310 Sep 03 11:31:58.776573 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-542ceaf7-c1d0-42db-95d6-ecd331b65f6b req-bceed5b8-f024-4d32-af40-0a9505fc37fd tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1344771 Sep 03 11:31:58.897501 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-56418054-1799-4812-9332-253558ca19ef req-e9e8223a-282c-4f8e-b240-4ea4c6109557 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1616092 Sep 03 11:31:58.998220 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:53Z', 'revision_number': 4, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '326f79cc-141e-458a-90e2-e269ba7aae4a', 'name': '', 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'mac_address': 'fa:16:3e:d1:2c:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:51Z', 'updated_at': '2021-09-03T11:31:57Z', 'revision_number': 4, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'subnets': [{'id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:31:59.060431 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1af79ae8-a6d4-416b-a98b-cf3300e2a901 None None] The sync data for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi is: [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:31:53Z', 'revision_number': 4, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '326f79cc-141e-458a-90e2-e269ba7aae4a', 'name': '', 'network_id': '20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'mac_address': 'fa:16:3e:d1:2c:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_interface', 'standard_attr_id': 339, 'fixed_ips': [{'subnet_id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:51Z', 'updated_at': '2021-09-03T11:31:57Z', 'revision_number': 4, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'subnets': [{'id': 'c0748bec-114c-4f3f-b270-c063a7c46018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:31:59.072852 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:31:59.096845 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd4ec84-475e-45d0-86f6-ec1c02e24f7b req-3dfdb096-9bc6-4489-be6c-edcb92e95073 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:59.104590 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2cd4ec84-475e-45d0-86f6-ec1c02e24f7b req-3dfdb096-9bc6-4489-be6c-edcb92e95073 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1328123 Sep 03 11:31:59.191100 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2cd4ec84-475e-45d0-86f6-ec1c02e24f7b req-c7808230-31b2-43ae-9f56-1bede508aa78 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853417 Sep 03 11:31:59.715116 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 368ea95a-ef61-469d-80b4-d3fb48c24275 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:31:59.923275 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=368ea95a-ef61-469d-80b4-d3fb48c24275,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:31:59.939643 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '368ea95a-ef61-469d-80b4-d3fb48c24275', 'network_id': 'aca5ae01-5c6f-4607-8a45-d689affa9a6c', 'port_id': '368ea95a-ef61-469d-80b4-d3fb48c24275', 'mac_address': 'fa:16:3e:55:a0:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '900851b5-cacf-47af-aee5-848c49e99979', 'ip_address': '192.168.233.79'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:31:59.955785 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6c744b-d024-4c44-b25d-21be133f8ba8 req-62c73d49-71f7-4c23-b2ca-ff383f87d70a tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:31:59.964558 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4d6c744b-d024-4c44-b25d-21be133f8ba8 req-62c73d49-71f7-4c23-b2ca-ff383f87d70a tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 947 time: 0.0717559 Sep 03 11:32:00.028959 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4d6c744b-d024-4c44-b25d-21be133f8ba8 req-1eaae6df-5237-4952-a7a0-24f285b09b29 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621057 Sep 03 11:32:00.065628 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:00.084402 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 368ea95a-ef61-469d-80b4-d3fb48c24275 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:00.129245 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=368ea95a-ef61-469d-80b4-d3fb48c24275,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:00.173236 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0154a34-7ddd-4355-a457-93684699d82d req-029c3dc1-6b8e-442c-8a16-a31b1a1f784d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:00.176273 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0154a34-7ddd-4355-a457-93684699d82d req-029c3dc1-6b8e-442c-8a16-a31b1a1f784d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1130724 Sep 03 11:32:00.183396 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:00.316122 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0154a34-7ddd-4355-a457-93684699d82d req-64fe1080-0442-4804-9b51-2a35d99cd3e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1388783 Sep 03 11:32:00.351645 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:00.434200 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41372313-30da-432d-9a55-25c8087d14d5 req-dcef9ccb-3e5d-4c50-80ff-ca047fc76892 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:00.442852 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41372313-30da-432d-9a55-25c8087d14d5 req-dcef9ccb-3e5d-4c50-80ff-ca047fc76892 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0929201 Sep 03 11:32:00.491568 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41372313-30da-432d-9a55-25c8087d14d5 req-15bb03aa-3cdb-4597-9804-d95dda345555 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460963 Sep 03 11:32:00.497751 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['368ea95a-ef61-469d-80b4-d3fb48c24275'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:00.881649 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 326f79cc-141e-458a-90e2-e269ba7aae4a up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:01.097706 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 326f79cc-141e-458a-90e2-e269ba7aae4a completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:01.103130 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 326f79cc-141e-458a-90e2-e269ba7aae4a triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:01.103741 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:01.255067 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d762f2-462a-4d49-9d21-71914534752a req-4cb58016-7885-4ab4-b661-0d4f5aa2650f tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:01.266579 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41d762f2-462a-4d49-9d21-71914534752a req-4cb58016-7885-4ab4-b661-0d4f5aa2650f tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 948 time: 0.0894458 Sep 03 11:32:01.326335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:01.332444 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41d762f2-462a-4d49-9d21-71914534752a req-4bc14b8a-f453-4d99-93ea-b523c62b5348 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649428 Sep 03 11:32:01.401556 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 326f79cc-141e-458a-90e2-e269ba7aae4a, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=326f79cc-141e-458a-90e2-e269ba7aae4a,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:01.469321 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:01.510208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf688e83-4d19-4360-b8bd-43a946d9aac2 req-76812cbd-2006-47a1-92ef-85ba9e89b60e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:01.518340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cf688e83-4d19-4360-b8bd-43a946d9aac2 req-76812cbd-2006-47a1-92ef-85ba9e89b60e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0840030 Sep 03 11:32:01.570092 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cf688e83-4d19-4360-b8bd-43a946d9aac2 req-6669f4b3-8bad-4fc2-8aca-b4f0d8c9dfbe tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450003 Sep 03 11:32:01.698844 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7616fc8-fed3-4aca-9ca5-1f377dea3781 req-a2d564e9-01a4-4091-98c4-0aad3ed38f50 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:01.700645 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7616fc8-fed3-4aca-9ca5-1f377dea3781 req-a2d564e9-01a4-4091-98c4-0aad3ed38f50 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0876615 Sep 03 11:32:01.752616 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:01.777139 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7616fc8-fed3-4aca-9ca5-1f377dea3781 req-18448d88-c346-4aa8-9678-b98a84260d85 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688150 Sep 03 11:32:02.482970 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307748c5-ba27-4720-b7ac-f67c0e102a7e req-e4a0ba50-c44c-440b-8439-73e26c8cce58 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:02.484475 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-307748c5-ba27-4720-b7ac-f67c0e102a7e req-e4a0ba50-c44c-440b-8439-73e26c8cce58 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 948 time: 0.0503845 Sep 03 11:32:02.521363 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-307748c5-ba27-4720-b7ac-f67c0e102a7e req-05901d7e-3a3a-4acd-bc82-abe0ce3a1d51 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309122 Sep 03 11:32:02.679454 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f345fa3-6faa-4eea-8810-43ec46072294 req-f981a45a-37d9-4627-bf3c-4ad9fd101c29 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:02.680941 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7f345fa3-6faa-4eea-8810-43ec46072294 req-f981a45a-37d9-4627-bf3c-4ad9fd101c29 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0488775 Sep 03 11:32:02.726472 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7f345fa3-6faa-4eea-8810-43ec46072294 req-9026b78b-a3cb-4e2c-b721-1581951e0fdc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390704 Sep 03 11:32:02.833137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 326f79cc-141e-458a-90e2-e269ba7aae4a up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:02.905149 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0839eed2-02e9-4a1e-8ef5-ed65d2fcc8d1 req-53a04894-61d7-4f05-b662-2a25e3a047f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:02.912813 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0839eed2-02e9-4a1e-8ef5-ed65d2fcc8d1 req-53a04894-61d7-4f05-b662-2a25e3a047f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0694902 Sep 03 11:32:02.932697 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 326f79cc-141e-458a-90e2-e269ba7aae4a triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:02.933206 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:02.978512 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0839eed2-02e9-4a1e-8ef5-ed65d2fcc8d1 req-7f3bd98a-f8f7-4775-891f-56ddbac97c61 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557821 Sep 03 11:32:03.649407 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20fb241-8b22-40a4-bf5a-f59bb1647449 req-dc34fc69-7d83-462d-a5bb-c3817a48ce1b tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:03.651725 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c20fb241-8b22-40a4-bf5a-f59bb1647449 req-dc34fc69-7d83-462d-a5bb-c3817a48ce1b tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 948 time: 0.0590391 Sep 03 11:32:03.703010 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c20fb241-8b22-40a4-bf5a-f59bb1647449 req-a0c91d22-7b5e-477e-8772-d2ed35a667ca tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419173 Sep 03 11:32:03.879150 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39864596-2235-4c9f-ac4f-c751927003fd req-10f1e4dc-4054-4f34-979e-a1dbd86aeed7 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:03.887532 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39864596-2235-4c9f-ac4f-c751927003fd req-10f1e4dc-4054-4f34-979e-a1dbd86aeed7 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0632474 Sep 03 11:32:03.932137 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39864596-2235-4c9f-ac4f-c751927003fd req-a0ed14bd-2778-4f56-bfcb-033c18a8efc0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433872 Sep 03 11:32:04.115892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d85b93d-b3b1-4f3a-919f-64c0f53db0e8 req-5842b88a-76b7-4d30-b4be-4e96ca79954d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:04.117739 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d85b93d-b3b1-4f3a-919f-64c0f53db0e8 req-5842b88a-76b7-4d30-b4be-4e96ca79954d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0568559 Sep 03 11:32:04.159281 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d85b93d-b3b1-4f3a-919f-64c0f53db0e8 req-81c28404-4cd4-4066-bf99-23785752aef6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346022 Sep 03 11:32:04.828487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10d65987-b448-4f1b-ade8-e4a3cedea423 req-bee495c3-4b7d-4a86-9e28-aeea9cfe2530 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:04.830966 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-10d65987-b448-4f1b-ade8-e4a3cedea423 req-bee495c3-4b7d-4a86-9e28-aeea9cfe2530 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 948 time: 0.0535958 Sep 03 11:32:04.878214 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-10d65987-b448-4f1b-ade8-e4a3cedea423 req-d11f84e3-04f2-4f01-bed3-9c4cc33eed27 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374324 Sep 03 11:32:05.113246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34746) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:05.153947 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa57e40c-6d7e-4748-866c-4a183f8c6cf6 req-27e2a8e7-8d69-40c0-b5af-d03147ddf6b8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:05.166790 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fa57e40c-6d7e-4748-866c-4a183f8c6cf6 req-27e2a8e7-8d69-40c0-b5af-d03147ddf6b8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0770214 Sep 03 11:32:05.235046 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fa57e40c-6d7e-4748-866c-4a183f8c6cf6 req-6591667e-4e5b-434e-8906-eb27c58e06e4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726147 Sep 03 11:32:05.280529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fefb5812-cebb-4f64-828f-8f13596f14ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:05.405890 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e78ef8-d929-4c34-815c-9dc6052f8fc0 req-175e98ac-63ac-44a8-843b-a0f0b15e2ee6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:05.411057 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8e78ef8-d929-4c34-815c-9dc6052f8fc0 req-175e98ac-63ac-44a8-843b-a0f0b15e2ee6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1212678 Sep 03 11:32:05.415783 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fefb5812-cebb-4f64-828f-8f13596f14ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:05.450132 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8e78ef8-d929-4c34-815c-9dc6052f8fc0 req-fcd3562b-20d1-4e1e-b4d4-e0fe27eb6277 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348001 Sep 03 11:32:05.743987 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 368ea95a-ef61-469d-80b4-d3fb48c24275 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:05.937442 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fefb5812-cebb-4f64-828f-8f13596f14ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.001046 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 368ea95a-ef61-469d-80b4-d3fb48c24275 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:06.004636 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 368ea95a-ef61-469d-80b4-d3fb48c24275 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:06.005009 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.016543 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e71add5-c7ca-43f8-9711-7945386885b7 req-2a44a7c0-0352-424f-b6b3-0cf474b3fbae tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:06.024798 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e71add5-c7ca-43f8-9711-7945386885b7 req-2a44a7c0-0352-424f-b6b3-0cf474b3fbae tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 948 time: 0.0749006 Sep 03 11:32:06.081915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e71add5-c7ca-43f8-9711-7945386885b7 req-136feaae-cffc-48d6-9773-03f5bae048bf tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448694 Sep 03 11:32:06.102215 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.125885 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:06.128303 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3eb9c21-138b-431f-84d8-c5cf20e84edb" -d '{"events": [{"server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "name": "network-vif-plugged", "status": "completed", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:06.148452 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=368ea95a-ef61-469d-80b4-d3fb48c24275,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:06.185365 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-176aa38d-122e-4527-bab4-3b853952c85b x-openstack-request-id: req-176aa38d-122e-4527-bab4-3b853952c85b {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:06.185731 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "name": "network-vif-plugged", "status": "completed", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:06.186077 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-176aa38d-122e-4527-bab4-3b853952c85b {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:06.186740 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275', 'code': 200} Sep 03 11:32:06.194063 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34768) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:06.194242 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-fefb5812-cebb-4f64-828f-8f13596f14ca admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6720244088a249f2bd63a6c3005021a9&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0782056 Sep 03 11:32:06.195387 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fefb5812-cebb-4f64-828f-8f13596f14ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5b7f175-a2e7-4583-b258-b9cb69d9e982,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:06.228977 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.295094 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:06.310899 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.356374 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.448632 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c5c081-c143-48cb-9aec-b0a2dfa4aaab req-b6a93942-7d44-460c-8450-5d0f54c9a78d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:06.450715 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5c5c081-c143-48cb-9aec-b0a2dfa4aaab req-b6a93942-7d44-460c-8450-5d0f54c9a78d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1111565 Sep 03 11:32:06.498916 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5c5c081-c143-48cb-9aec-b0a2dfa4aaab req-f0e3d396-835f-4d74-89a0-51bb66160441 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409040 Sep 03 11:32:06.584175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.587719 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:06.591103 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a5b7f175-a2e7-4583-b258-b9cb69d9e982 HTTP/1.1" status: 204 len: 168 time: 0.3925514 Sep 03 11:32:06.653828 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1af21154-294b-4b4e-a8d2-9d6ba822406c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5b7f175-a2e7-4583-b258-b9cb69d9e982,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:06.696958 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3d52c2-76d9-4342-b81e-3309cf27d180 req-29a8628d-1124-4ea0-8f1f-497d54a1145a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:06.699415 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9b3d52c2-76d9-4342-b81e-3309cf27d180 req-29a8628d-1124-4ea0-8f1f-497d54a1145a service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 1102 time: 0.1473575 Sep 03 11:32:06.720500 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d118cca-489e-4545-a487-09843708939e req-8d9fdd65-2ec6-425a-aed5-5842cc576a2f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:06.734212 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d118cca-489e-4545-a487-09843708939e req-8d9fdd65-2ec6-425a-aed5-5842cc576a2f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1523056 Sep 03 11:32:06.797286 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d118cca-489e-4545-a487-09843708939e req-d32bbbb0-c5b7-417e-87b4-9900b0bb40a5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628135 Sep 03 11:32:06.814014 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9b3d52c2-76d9-4342-b81e-3309cf27d180 req-baec9479-3894-4ada-af59-2bcebed31464 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1044140 Sep 03 11:32:07.218981 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2611cb-743c-4d71-a4c4-1e3d8e4949eb req-e0b2226e-2bad-4a59-a8c9-a43fe454ba6a tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:07.226131 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e2611cb-743c-4d71-a4c4-1e3d8e4949eb req-e0b2226e-2bad-4a59-a8c9-a43fe454ba6a tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.0704885 Sep 03 11:32:07.266200 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e2611cb-743c-4d71-a4c4-1e3d8e4949eb req-e8771f28-674d-4dd8-bd8d-fe39c6581315 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390625 Sep 03 11:32:07.341069 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34794) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:07.362778 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f3ff29ca-fbde-46c9-a670-31c430c22dcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.458013 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f3ff29ca-fbde-46c9-a670-31c430c22dcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.531514 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f3ff29ca-fbde-46c9-a670-31c430c22dcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.576012 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f3ff29ca-fbde-46c9-a670-31c430c22dcb admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=02c12d1b266441849d983b05329f5318&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2332487 Sep 03 11:32:07.577425 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3ff29ca-fbde-46c9-a670-31c430c22dcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f24f5fa-0b6f-4642-a845-ecdf120711c1,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:07.578778 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34798) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:07.662350 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb86e7b-d2f1-4138-992b-4c7a4ced20fd req-dfb44e6f-d2cb-4577-bd0f-a5ee11dbc325 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:07.664091 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4eb86e7b-d2f1-4138-992b-4c7a4ced20fd req-dfb44e6f-d2cb-4577-bd0f-a5ee11dbc325 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0777066 Sep 03 11:32:07.689532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.728641 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.732585 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4eb86e7b-d2f1-4138-992b-4c7a4ced20fd req-bc915607-e57f-4b92-ac50-3e93a1e49d06 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601666 Sep 03 11:32:07.880406 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.883269 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:07.884476 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3f24f5fa-0b6f-4642-a845-ecdf120711c1 HTTP/1.1" status: 204 len: 168 time: 0.3045011 Sep 03 11:32:07.905718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e4c0b3-a88b-423a-a0f7-098055d64d55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f24f5fa-0b6f-4642-a845-ecdf120711c1,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:07.998652 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c58eecec-b878-4a40-a384-39a34c280331 req-a482df3d-28b3-4e44-8413-52fcddc558f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:08.000432 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c58eecec-b878-4a40-a384-39a34c280331 req-a482df3d-28b3-4e44-8413-52fcddc558f6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0697918 Sep 03 11:32:08.052530 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c58eecec-b878-4a40-a384-39a34c280331 req-8af3afc1-9e51-49d4-9ee3-5f794274a0e3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430858 Sep 03 11:32:08.454322 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b25c2a1e-f3f9-4e09-a142-e6e31cd7564e req-e4df0630-41ff-4c3a-886c-c9ecfcf729e3 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:08.457724 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b25c2a1e-f3f9-4e09-a142-e6e31cd7564e req-e4df0630-41ff-4c3a-886c-c9ecfcf729e3 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.0891519 Sep 03 11:32:08.476942 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34820) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:08.531024 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b25c2a1e-f3f9-4e09-a142-e6e31cd7564e req-304aa7eb-5487-4de0-84bd-739fbf96fed7 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593359 Sep 03 11:32:08.536650 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34824) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:08.668110 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-272da69f-5dcc-47ac-adcd-c2e54a6be430 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:08.810260 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-272da69f-5dcc-47ac-adcd-c2e54a6be430 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:08.867443 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6b9f7018-cee0-47cd-8c2c-134ea0e8778c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:08.885006 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-272da69f-5dcc-47ac-adcd-c2e54a6be430 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:08.942704 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-272da69f-5dcc-47ac-adcd-c2e54a6be430 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b864c1b2ddc14523abea3b14d0b79412&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4628172 Sep 03 11:32:08.950078 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34838) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:09.000464 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272da69f-5dcc-47ac-adcd-c2e54a6be430 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c397009-005c-48e6-8aa9-bb26f965e712,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:09.042481 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec629d61-ae44-4b63-8549-bba96b5d3bef req-3d33bcd6-af57-4a51-b4aa-7c29b9d6a712 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:09.044599 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec629d61-ae44-4b63-8549-bba96b5d3bef req-3d33bcd6-af57-4a51-b4aa-7c29b9d6a712 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.2021260 Sep 03 11:32:09.079835 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.112872 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec629d61-ae44-4b63-8549-bba96b5d3bef req-c7ece68b-5eca-457e-a47f-e713c3821ccf tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501511 Sep 03 11:32:09.134436 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6b9f7018-cee0-47cd-8c2c-134ea0e8778c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.146724 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.246464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174924d5-f41d-410d-be7d-5bcb9b064a5f req-c433f26f-ce42-4e02-b3ee-ef9b3baac23d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:09.246464 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-174924d5-f41d-410d-be7d-5bcb9b064a5f req-c433f26f-ce42-4e02-b3ee-ef9b3baac23d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0995185 Sep 03 11:32:09.298876 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-174924d5-f41d-410d-be7d-5bcb9b064a5f req-a862a971-2e53-4f3d-bc52-5ffad9eacdb8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530093 Sep 03 11:32:09.646589 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495253ec-eafa-4f4b-8174-e366c9b2c687 req-018bc243-146f-4849-820c-495cddc7fc19 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:09.648678 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-495253ec-eafa-4f4b-8174-e366c9b2c687 req-018bc243-146f-4849-820c-495cddc7fc19 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.0506701 Sep 03 11:32:09.685002 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-495253ec-eafa-4f4b-8174-e366c9b2c687 req-77167de8-cbd1-42f2-9ba5-a7f97d73c279 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304816 Sep 03 11:32:09.845887 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6b9f7018-cee0-47cd-8c2c-134ea0e8778c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.880167 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.882979 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9f7018-cee0-47cd-8c2c-134ea0e8778c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2248a7ed-d92b-4402-87c7-8086c478fd96,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:09.883616 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.888265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/5c397009-005c-48e6-8aa9-bb26f965e712 HTTP/1.1" status: 204 len: 168 time: 0.9294124 Sep 03 11:32:09.888443 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6b9f7018-cee0-47cd-8c2c-134ea0e8778c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a8e6889d07d34c3c94836b62c5473820&name=default HTTP/1.1" status: 200 len: 2979 time: 1.3502398 Sep 03 11:32:09.890718 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34856) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:09.906552 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88da14f9-cdef-4891-acf4-e846c689e83d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c397009-005c-48e6-8aa9-bb26f965e712,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:09.954003 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:09.975307 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:10.206937 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:10.209218 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:10.213270 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2248a7ed-d92b-4402-87c7-8086c478fd96 HTTP/1.1" status: 204 len: 168 time: 0.3215494 Sep 03 11:32:10.228528 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c925202a-7a5a-4db5-96cc-eaff5780c5cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2248a7ed-d92b-4402-87c7-8086c478fd96,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:10.266529 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a8df9b6-0376-47b8-a099-bb4a05ba3384 req-962b79c7-b817-4067-a73a-f48cb70dc1bb tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:10.276160 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9a8df9b6-0376-47b8-a099-bb4a05ba3384 req-962b79c7-b817-4067-a73a-f48cb70dc1bb tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0846441 Sep 03 11:32:10.378556 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9a8df9b6-0376-47b8-a099-bb4a05ba3384 req-413c500b-5918-4877-b8bf-e0e5407f185c tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1010375 Sep 03 11:32:10.557696 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad92834d-6924-440e-9267-728200ea6d4b req-7211e67c-4d65-4f7a-88e6-7fea44617893 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:10.565657 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ad92834d-6924-440e-9267-728200ea6d4b req-7211e67c-4d65-4f7a-88e6-7fea44617893 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.1683044 Sep 03 11:32:10.610154 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663aee16-58c0-4942-bf7c-f411f88e4620 req-ffd730e9-bf96-4fde-b88d-951108f65e81 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:10.610154 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-663aee16-58c0-4942-bf7c-f411f88e4620 req-ffd730e9-bf96-4fde-b88d-951108f65e81 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1206574 Sep 03 11:32:10.660544 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ad92834d-6924-440e-9267-728200ea6d4b req-83a4c13e-575a-4cf0-bf1e-e189d1531b6b tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936489 Sep 03 11:32:10.778220 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-663aee16-58c0-4942-bf7c-f411f88e4620 req-d331dd88-d817-46c8-a182-fabde7a3a19a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1678929 Sep 03 11:32:10.805112 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-d7d6772f-204a-4528-bbfc-8551342c07a7 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1434278 Sep 03 11:32:10.890518 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-dcbd53aa-0b8e-46c3-80f0-3e50ea3e2c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:10.892131 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-dcbd53aa-0b8e-46c3-80f0-3e50ea3e2c1f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1099 time: 0.0485890 Sep 03 11:32:11.028530 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-ab71aa53-835d-47f2-9767-d95b1c4e095f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.030025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-ab71aa53-835d-47f2-9767-d95b1c4e095f service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.0875988 Sep 03 11:32:11.135290 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-7f8e782c-5f1f-44de-865c-2684da31ae6c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 1002 time: 0.0953646 Sep 03 11:32:11.208102 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-914df6d7-5043-432b-b1b8-2ccd7e5fcef0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.209666 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-914df6d7-5043-432b-b1b8-2ccd7e5fcef0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0518556 Sep 03 11:32:11.273137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-8aeb940e-17c6-438b-856a-8183e4462845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.274680 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-8aeb940e-17c6-438b-856a-8183e4462845 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0564208 Sep 03 11:32:11.375769 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc0ba0b-e380-44f4-bb0e-e551c16d6201 req-0be87221-82be-45f0-ac5d-feebbc15c43f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.377320 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-abc0ba0b-e380-44f4-bb0e-e551c16d6201 req-0be87221-82be-45f0-ac5d-feebbc15c43f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1009891 Sep 03 11:32:11.426868 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-13c5d85c-bc45-4425-a736-d93bc8f85668 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1421399 Sep 03 11:32:11.432207 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-abc0ba0b-e380-44f4-bb0e-e551c16d6201 req-f5c21d5a-9111-4f06-9ce4-50d83c88e711 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485425 Sep 03 11:32:11.498946 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 34912) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:11.546875 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d9506e5-1635-4f18-91f4-a14249a6483e req-ef754030-576f-416b-98df-92ba03d61f29 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953646 Sep 03 11:32:11.640539 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f0ee0d15-94cb-49ec-95b4-c5938fc2d0f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:11.725995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-2d59ee19-7351-4457-aa3d-ede29a29e1a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.729727 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-2d59ee19-7351-4457-aa3d-ede29a29e1a5 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1099 time: 0.0488605 Sep 03 11:32:11.749802 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f0ee0d15-94cb-49ec-95b4-c5938fc2d0f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:11.812221 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f0ee0d15-94cb-49ec-95b4-c5938fc2d0f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:11.859468 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f0ee0d15-94cb-49ec-95b4-c5938fc2d0f4 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=91bf1e211918486aad71fe2780116afe&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3593187 Sep 03 11:32:11.860730 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 34934) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:11.860876 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ee0d15-94cb-49ec-95b4-c5938fc2d0f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f90b3eb-134c-4d0d-809e-fcdf7ab8052a,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:11.869112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8010ec20-356e-4ef3-823d-d521cd504b2c req-c3cf5ba4-0c71-46a9-856b-f6cabf3ac045 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.871252 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8010ec20-356e-4ef3-823d-d521cd504b2c req-c3cf5ba4-0c71-46a9-856b-f6cabf3ac045 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.1010947 Sep 03 11:32:11.921405 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-9a97286d-d3f1-4a85-94f2-a0ca59e77ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:11.922868 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-9a97286d-d3f1-4a85-94f2-a0ca59e77ad6 service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.1802673 Sep 03 11:32:12.048473 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8010ec20-356e-4ef3-823d-d521cd504b2c req-999c6abf-e057-43c6-82d9-398090f9d580 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/security-groups?id=f474df08-b0fd-4b3d-8124-4308d8d1e193&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1625087 Sep 03 11:32:12.090144 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.117073 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-422b3f73-e181-41a1-ad01-ac72da021a54 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 1002 time: 0.1725047 Sep 03 11:32:12.157189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-a8451fd3-466c-461a-a986-6cd389fb8d36 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.158714 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-a8451fd3-466c-461a-a986-6cd389fb8d36 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.11 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 949 time: 0.0507410 Sep 03 11:32:12.275528 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Deleting port 368ea95a-ef61-469d-80b4-d3fb48c24275 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:32:12.275868 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.368955 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] For port 368ea95a-ef61-469d-80b4-d3fb48c24275, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=368ea95a-ef61-469d-80b4-d3fb48c24275,segment=NetworkSegment(6ed52ab9-b39d-44c8-aab2-33332f5ea8fb),segment_id=6ed52ab9-b39d-44c8-aab2-33332f5ea8fb)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:12.369317 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.371953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.379580 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-debbd781-1b1d-4721-a011-9f6224291bec tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.381067 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-debbd781-1b1d-4721-a011-9f6224291bec tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 814 time: 0.4795532 Sep 03 11:32:12.382812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Calling delete_port for 368ea95a-ef61-469d-80b4-d3fb48c24275 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:32:12.451072 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-7db82097-1379-41ce-aa98-66ca4780d83d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/quotas/a929f96c596b45e78449a64936959efe HTTP/1.1" status: 200 len: 375 time: 0.0594263 Sep 03 11:32:12.477588 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fded1c77-fb93-4ebd-beb0-1608a004a303 req-8c127f75-7ae0-46df-b5ba-b7b635475924 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.479116 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fded1c77-fb93-4ebd-beb0-1608a004a303 req-8c127f75-7ae0-46df-b5ba-b7b635475924 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.3730381 Sep 03 11:32:12.483282 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-ee9532b3-ec56-4b67-9167-cf04b22bef45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.484290 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-ee9532b3-ec56-4b67-9167-cf04b22bef45 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.1340485 Sep 03 11:32:12.576043 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-6f1827d1-2035-43c6-b2fa-5788f01f6ad3 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1181257 Sep 03 11:32:12.584202 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fded1c77-fb93-4ebd-beb0-1608a004a303 req-c7ec0abb-1893-49d4-a33a-5fc5249e72f3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818672 Sep 03 11:32:12.587682 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-ff842127-a175-4b7a-b420-633534e164dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.589118 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-ff842127-a175-4b7a-b420-633534e164dd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0880754 Sep 03 11:32:12.601988 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.614653 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['368ea95a-ef61-469d-80b4-d3fb48c24275'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:12.637308 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Pushing event deleted for resources: {'Port': ['ID=368ea95a-ef61-469d-80b4-d3fb48c24275,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:12.646031 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.651006 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.652487 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2f90b3eb-134c-4d0d-809e-fcdf7ab8052a HTTP/1.1" status: 204 len: 168 time: 0.7808433 Sep 03 11:32:12.713814 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] No DVR routers for this DVR port 368ea95a-ef61-469d-80b4-d3fb48c24275 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:32:12.716408 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:12.718699 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-cb2cb5d6-fb5b-400e-b47b-56117ce126a3 req-33a4ac67-d44c-431d-9334-248d71ec66a6 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.11 "DELETE /v2.0/ports/368ea95a-ef61-469d-80b4-d3fb48c24275 HTTP/1.1" status: 204 len: 173 time: 0.5389309 Sep 03 11:32:12.719210 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'name': 'network-vif-deleted', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:12.721486 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1dfbf23e-ffe0-4a33-a753-abe2fe368eb4" -d '{"events": [{"server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "name": "network-vif-deleted", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:12.759412 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751b624d-96c1-43cd-96ca-3a27cbf1f8ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f90b3eb-134c-4d0d-809e-fcdf7ab8052a,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:12.868229 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-24e9eaca-895e-486d-85df-748584b70011 service neutron] 10.222.0.16 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2748864 Sep 03 11:32:12.886278 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918cf7e4-6770-4c87-b787-15060f556e5a req-63ee8224-eeed-4650-893c-ce3819adb3e9 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:12.887879 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-918cf7e4-6770-4c87-b787-15060f556e5a req-63ee8224-eeed-4650-893c-ce3819adb3e9 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1478403 Sep 03 11:32:12.889609 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-9b770d76-5afd-4f9b-8062-4c1acbf1d712 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2726471 Sep 03 11:32:13.039850 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-918cf7e4-6770-4c87-b787-15060f556e5a req-1f09fe93-d755-4420-877a-881e5ad6f5ab tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1384842 Sep 03 11:32:13.080213 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f13c87c-6d2a-49ea-81a2-52f5f1c7297a req-5c795194-183c-492b-8dfb-886a60801946 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1799183 Sep 03 11:32:13.082803 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-a749cfc2-86ee-46aa-a3eb-e28069bb3481 service neutron] 10.222.0.16 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2136822 Sep 03 11:32:13.105964 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5acc5cb-9b34-4fc8-a9e8-e567694fefc2 x-openstack-request-id: req-a5acc5cb-9b34-4fc8-a9e8-e567694fefc2 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:13.106507 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5000d6d3-4996-49e6-8a48-3cd97f582edd", "name": "network-vif-deleted", "tag": "368ea95a-ef61-469d-80b4-d3fb48c24275", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:13.107051 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a5acc5cb-9b34-4fc8-a9e8-e567694fefc2 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:13.107649 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5000d6d3-4996-49e6-8a48-3cd97f582edd', 'name': 'network-vif-deleted', 'tag': '368ea95a-ef61-469d-80b4-d3fb48c24275', 'status': 'completed', 'code': 200} Sep 03 11:32:13.250807 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8a06a3f-a371-4fe9-b4ac-736ab56a479c req-4b2ec69a-7568-401e-9704-5e5fd80ecb93 tempest-VolumesNegativeTest-1910546196 tempest-VolumesNegativeTest-1910546196-project] 10.222.0.16 "GET /v2.0/ports?device_id=5000d6d3-4996-49e6-8a48-3cd97f582edd HTTP/1.1" status: 200 len: 210 time: 0.0282028 Sep 03 11:32:13.396323 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4a12276f-0e50-49eb-928b-f38259a810f3 req-ffebc904-f277-4a7e-b261-319d61e90acf tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 210 time: 0.0394380 Sep 03 11:32:13.523323 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-2e027076-808e-4407-bba3-ce7fefd075fd tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:13.526095 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-2e027076-808e-4407-bba3-ce7fefd075fd tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.1288333 Sep 03 11:32:13.542830 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-92513da2-9e54-4c09-a0fc-0c2c2418b79d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/quotas/7b665fdb80b4480ca82ebd31568efb7c HTTP/1.1" status: 200 len: 375 time: 0.0095863 Sep 03 11:32:13.605840 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-f63c54cb-6b6b-4b18-809a-a33387e06e57 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0585930 Sep 03 11:32:13.719989 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:13.755665 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-8c090186-cc15-484a-aae3-71fcc66e3570 service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361699 Sep 03 11:32:13.769548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fffc284-2547-4807-895b-5b99f637506a req-5b0788b7-8505-4639-9dd4-b0e372821734 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:13.771140 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2fffc284-2547-4807-895b-5b99f637506a req-5b0788b7-8505-4639-9dd4-b0e372821734 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0835052 Sep 03 11:32:13.871449 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2fffc284-2547-4807-895b-5b99f637506a req-acdde9ac-c924-4b85-a927-e0966e0c3c84 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912511 Sep 03 11:32:13.905425 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-db4abf57-9925-49d2-82ab-7fe243898d7a service neutron] 10.222.0.16 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1332500 Sep 03 11:32:14.201280 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a39f1fbc-8252-411c-82c4-2c958eb6549a req-ca628768-bcff-4de2-9b7d-bf06c7275af1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 210 time: 0.0373676 Sep 03 11:32:14.218090 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6815315-190f-4609-810b-08ec05d39f0d req-5b7d9de2-d6fb-4155-a7ce-602c232a8c3a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:14.219750 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e6815315-190f-4609-810b-08ec05d39f0d req-5b7d9de2-d6fb-4155-a7ce-602c232a8c3a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0969763 Sep 03 11:32:14.264321 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e6815315-190f-4609-810b-08ec05d39f0d req-dffec0f7-97c7-4055-a64d-4d0ebace378f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356059 Sep 03 11:32:14.491102 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2881a3c6-d5ca-4584-9f6d-ea55c16dcaf0 req-7f729ead-e853-419e-8104-cb3add961ee4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 210 time: 0.0289960 Sep 03 11:32:14.999424 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d36332f-7675-486b-86fa-4b0cb8fc2050 req-bbf36f02-f1c7-449d-ac1e-862dd197e445 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:15.001011 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d36332f-7675-486b-86fa-4b0cb8fc2050 req-bbf36f02-f1c7-449d-ac1e-862dd197e445 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0505595 Sep 03 11:32:15.039442 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2d36332f-7675-486b-86fa-4b0cb8fc2050 req-0f485e9d-729f-4dfe-bf40-552fa2e57341 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321507 Sep 03 11:32:15.291912 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a17424c-9f02-49ba-824a-2ed61329983c req-bb14aabe-b020-4efd-91c8-3892d2c0cf8b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 210 time: 0.0283868 Sep 03 11:32:15.615576 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-89da27cf-9a8c-439e-8952-1ebf1df88fa9 req-a53d006c-3d4b-40db-8640-8e5be87eeaee tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 210 time: 0.0439451 Sep 03 11:32:15.683811 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-17b2f227-12a2-4fbc-8568-9aa2e4cd0fd6 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:15.685788 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-17b2f227-12a2-4fbc-8568-9aa2e4cd0fd6 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 814 time: 0.1407568 Sep 03 11:32:15.705618 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'port': {'device_id': '496f48b8-0710-41da-907b-a7938371e02d', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'admin_state_up': True, 'tenant_id': 'a929f96c596b45e78449a64936959efe'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:15.768603 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 368ea95a-ef61-469d-80b4-d3fb48c24275 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:32:15.788799 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 368ea95a-ef61-469d-80b4-d3fb48c24275 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:32:15.789139 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 368ea95a-ef61-469d-80b4-d3fb48c24275 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:32:15.942819 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Made reservation on behalf of a929f96c596b45e78449a64936959efe for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:15.946483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:16.077059 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Allocated IP 172.20.0.12 (f39e51e6-3ab9-4955-9302-06484ab5c362/fe371eea-dd00-405f-8801-d52a715cf14f/0c1a0140-6eb6-4bae-ba93-b742e42fed8e) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:32:16.260661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75705304-9b50-4d40-84f5-eb0a8812f8a0 req-e12e2bff-ae79-4e64-a3e6-4f6576b333e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:16.268120 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75705304-9b50-4d40-84f5-eb0a8812f8a0 req-e12e2bff-ae79-4e64-a3e6-4f6576b333e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1494973 Sep 03 11:32:16.324818 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75705304-9b50-4d40-84f5-eb0a8812f8a0 req-b5ff075f-c765-406b-88dc-a11c43bd9151 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558045 Sep 03 11:32:16.354193 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:16.369323 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Transition to ACTIVE for port object 0c1a0140-6eb6-4bae-ba93-b742e42fed8e will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:32:16.407983 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-5b33b894-5971-43db-8ab6-3fb39aba717a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:16.410515 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-5b33b894-5971-43db-8ab6-3fb39aba717a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 815 time: 0.1482375 Sep 03 11:32:16.413551 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd4138af-364a-4919-819d-1a8edfc795b2 req-73c6c0fe-545d-4ef4-95bb-71a3f230e408 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 210 time: 0.0355244 Sep 03 11:32:16.426686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Request body: {'port': {'device_id': '7f439798-36cf-4159-98d8-7530412a9647', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'admin_state_up': True, 'tenant_id': '7b665fdb80b4480ca82ebd31568efb7c'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:16.520444 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:16.568687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Network f39e51e6-3ab9-4955-9302-06484ab5c362 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:32:16.574537 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:16.579023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:32:16.592592 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:16.627012 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Made reservation on behalf of 7b665fdb80b4480ca82ebd31568efb7c for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:16.637435 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:16.655009 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:16.655983 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:16.748950 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-e24a0c2c-b316-42d2-b256-cd25b62a208b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0467904 Sep 03 11:32:16.809106 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b995dc38-a1b9-4a2d-86fe-4a27ba847b23 req-bf259580-c6d0-4b83-88f4-7615a703ce2b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:16.826329 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b995dc38-a1b9-4a2d-86fe-4a27ba847b23 req-bf259580-c6d0-4b83-88f4-7615a703ce2b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0962420 Sep 03 11:32:16.882211 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b995dc38-a1b9-4a2d-86fe-4a27ba847b23 req-1015af1d-bced-4543-b220-c59c70b3c624 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487125 Sep 03 11:32:16.908320 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Allocated IP 172.20.0.11 (778c15f4-3719-4d66-9e6d-1be38ac5cc42/c64b6662-4e29-47d5-96b7-4719ce1edb33/3f1d41ae-f270-4229-8991-c6a9aa7b7b6c) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:32:17.045901 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e357d3d8-c9a9-4649-8717-bcb8df1b21d6 None None] Provisioning for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:17.049992 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e357d3d8-c9a9-4649-8717-bcb8df1b21d6 None None] Provisioning complete for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:17.050569 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e357d3d8-c9a9-4649-8717-bcb8df1b21d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:17.085634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:17.089271 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-e357d3d8-c9a9-4649-8717-bcb8df1b21d6 None None] Port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:32:17.183484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:17.240043 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:32:17.247785 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:17.251041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:32:17.255585 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event updated for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:17.319669 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:17.320325 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:17.411061 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-b32640e3-35ee-41d8-8317-d15ce162a7d0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9900899 Sep 03 11:32:17.489197 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d88103-d120-41ff-ab60-e127229915b4 req-14a6777a-8238-44a5-b167-51db058761d5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:17.490840 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-55d88103-d120-41ff-ab60-e127229915b4 req-14a6777a-8238-44a5-b167-51db058761d5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0845418 Sep 03 11:32:17.564202 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-55d88103-d120-41ff-ab60-e127229915b4 req-fa40e371-6688-4b8f-8614-39880405d9d3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669765 Sep 03 11:32:17.578196 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fed4fb3-d380-432c-9332-6b2181177557 req-3dea4eef-99e4-48b4-9100-ca9d2f71a801 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:17.579942 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4fed4fb3-d380-432c-9332-6b2181177557 req-3dea4eef-99e4-48b4-9100-ca9d2f71a801 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0760369 Sep 03 11:32:17.619757 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4fed4fb3-d380-432c-9332-6b2181177557 req-da7e331e-ab07-4085-a231-7abab5b61db0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334122 Sep 03 11:32:18.002922 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d9a206-352f-48ec-bba5-4b6fc95e8321 req-69014e5b-afe3-4c8c-a893-75751c58b646 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:18.004796 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-09d9a206-352f-48ec-bba5-4b6fc95e8321 req-69014e5b-afe3-4c8c-a893-75751c58b646 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0591676 Sep 03 11:32:18.054363 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-09d9a206-352f-48ec-bba5-4b6fc95e8321 req-9885f29c-b534-4ad9-84af-7ff7fd763bed tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395513 Sep 03 11:32:18.757681 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fb395d-2f51-4f98-a01f-84cbaa459855 req-a3dfd120-8d33-466e-9195-b4cce4e6702c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:18.759589 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f2fb395d-2f51-4f98-a01f-84cbaa459855 req-a3dfd120-8d33-466e-9195-b4cce4e6702c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1018317 Sep 03 11:32:18.818810 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e14051-9623-40e9-828e-3589bc443bdf req-38b3a915-fd32-439d-a3b5-7c72b087cce1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:18.827006 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28e14051-9623-40e9-828e-3589bc443bdf req-38b3a915-fd32-439d-a3b5-7c72b087cce1 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.1145926 Sep 03 11:32:18.850025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f2fb395d-2f51-4f98-a01f-84cbaa459855 req-4073773e-7317-4fff-9781-e08196c6f090 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792480 Sep 03 11:32:18.891208 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28e14051-9623-40e9-828e-3589bc443bdf req-520895f1-0950-4b1c-9929-9a19e81738bf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623484 Sep 03 11:32:19.203654 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8959a521-eb32-4b52-946b-551bbdf0ac4b req-22e85e91-869f-4a8a-b65c-1e448672d004 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:19.205378 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8959a521-eb32-4b52-946b-551bbdf0ac4b req-22e85e91-869f-4a8a-b65c-1e448672d004 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0627725 Sep 03 11:32:19.257140 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8959a521-eb32-4b52-946b-551bbdf0ac4b req-5591abd3-2388-4447-800c-0487e741a3d5 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431869 Sep 03 11:32:19.599335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8', 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', '221c6012-4b26-4d7d-b7e8-145356803449'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:19.951732 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:32:19.983365 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fbfb35-8469-441a-84f0-10b4dafdd8ef req-fe882019-d825-46b9-8c71-add719845f54 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:19.984970 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0fbfb35-8469-441a-84f0-10b4dafdd8ef req-fe882019-d825-46b9-8c71-add719845f54 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0529885 Sep 03 11:32:20.050264 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0fbfb35-8469-441a-84f0-10b4dafdd8ef req-e92c9068-c347-4130-9c28-fd0b5e0e95f3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548565 Sep 03 11:32:20.061047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc034e6-d19b-44ce-bcb7-8ff6ad3eae96 req-c6ef1d7d-8566-47b5-ac32-1631aaf4b6b8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:20.062553 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dc034e6-d19b-44ce-bcb7-8ff6ad3eae96 req-c6ef1d7d-8566-47b5-ac32-1631aaf4b6b8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0756364 Sep 03 11:32:20.103364 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dc034e6-d19b-44ce-bcb7-8ff6ad3eae96 req-1004e281-b0ed-4e54-8b4d-78fd29529d6a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345647 Sep 03 11:32:20.389873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8fbdec-49b9-4044-b907-9a6039cc57d1 req-769af706-b06d-4b9a-bb08-df351f1d4b9d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:20.391425 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f8fbdec-49b9-4044-b907-9a6039cc57d1 req-769af706-b06d-4b9a-bb08-df351f1d4b9d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0624804 Sep 03 11:32:20.432633 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f8fbdec-49b9-4044-b907-9a6039cc57d1 req-9e2c46ce-c73b-4be0-a3be-f359a8c8da7b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336936 Sep 03 11:32:20.748549 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35320) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:20.885049 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8cede727-6d84-4bdc-bfdd-4d51548d8a33 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8172f792c7e144a9ba62b98f19d1c789&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1353490 Sep 03 11:32:20.887486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35330) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:20.940085 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:20.963295 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:21.158942 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:21.161548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:21.165664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f474df08-b0fd-4b3d-8124-4308d8d1e193 HTTP/1.1" status: 204 len: 168 time: 0.2743692 Sep 03 11:32:21.175161 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f1d0be6-e11e-4263-ae43-8e3553ed7c3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f474df08-b0fd-4b3d-8124-4308d8d1e193,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:21.189357 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ce0068-df96-4896-b5bf-88b05cf07c2c req-4d476608-4cb5-4b2a-8e90-81b7aa4c5b34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:21.191078 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e4ce0068-df96-4896-b5bf-88b05cf07c2c req-4d476608-4cb5-4b2a-8e90-81b7aa4c5b34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0726449 Sep 03 11:32:21.289606 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e4ce0068-df96-4896-b5bf-88b05cf07c2c req-a138343c-bba4-45be-861e-0ab4e0b8521e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820675 Sep 03 11:32:21.300574 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efb1eb15-8ce4-4c7b-8626-15b4f71ee299 req-b06f237b-88b4-4d1e-9e0f-3ffeac0afd0e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:21.302051 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-efb1eb15-8ce4-4c7b-8626-15b4f71ee299 req-b06f237b-88b4-4d1e-9e0f-3ffeac0afd0e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0967202 Sep 03 11:32:21.352373 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-efb1eb15-8ce4-4c7b-8626-15b4f71ee299 req-3bb55a09-f049-42d6-a989-a7fdb969cd24 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425339 Sep 03 11:32:21.572721 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f799123d-aeaf-44ba-b555-6c40c2e73566 req-4ff51b13-dfe0-499b-85ee-35dd00ff54a9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:21.575838 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f799123d-aeaf-44ba-b555-6c40c2e73566 req-4ff51b13-dfe0-499b-85ee-35dd00ff54a9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0652695 Sep 03 11:32:21.626619 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f799123d-aeaf-44ba-b555-6c40c2e73566 req-c0724ff0-be0e-4ccf-bd4c-f18661da0e53 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453513 Sep 03 11:32:22.417214 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45295411-975a-4df6-b97b-e8568d270846 req-f64ba629-7e23-41f3-8500-065a78fb576c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:22.418915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-45295411-975a-4df6-b97b-e8568d270846 req-f64ba629-7e23-41f3-8500-065a78fb576c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0567973 Sep 03 11:32:22.484927 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-45295411-975a-4df6-b97b-e8568d270846 req-6c57cc37-5053-4eeb-b735-b5c6dcb74086 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600207 Sep 03 11:32:22.501034 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a77e82-bd04-4f79-8f90-954c9d6a6e0f req-1140d0ae-5c07-4dee-a397-8d9485af8185 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:22.502506 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8a77e82-bd04-4f79-8f90-954c9d6a6e0f req-1140d0ae-5c07-4dee-a397-8d9485af8185 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0704076 Sep 03 11:32:22.539773 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f8a77e82-bd04-4f79-8f90-954c9d6a6e0f req-5b9759de-e6e6-4a0f-8f85-f7c3c15b372b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308368 Sep 03 11:32:22.741778 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5230d4a-11f7-46c7-85de-c2efc9190a87 req-ad7a238a-a0e6-4f16-a007-3fb040120667 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:22.744138 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5230d4a-11f7-46c7-85de-c2efc9190a87 req-ad7a238a-a0e6-4f16-a007-3fb040120667 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0483243 Sep 03 11:32:22.784328 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5230d4a-11f7-46c7-85de-c2efc9190a87 req-61df5a4b-b9fe-45d0-ae45-ed7fba32bf7f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342271 Sep 03 11:32:23.666055 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1427c1-95a3-4bb5-a968-8fb17ec120a2 req-a8cac528-3d3e-4b1e-b887-42a172d368ed tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:23.667802 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eb1427c1-95a3-4bb5-a968-8fb17ec120a2 req-a8cac528-3d3e-4b1e-b887-42a172d368ed tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0997221 Sep 03 11:32:23.689751 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1313eaf-56a8-4473-b247-7e3c05e6fedf req-26759626-b02e-4259-bc17-c17a5d893dbf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:23.696226 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1313eaf-56a8-4473-b247-7e3c05e6fedf req-26759626-b02e-4259-bc17-c17a5d893dbf tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0809045 Sep 03 11:32:23.746849 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eb1427c1-95a3-4bb5-a968-8fb17ec120a2 req-6f23d84a-f195-4cc2-958b-42c63ab1f730 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721450 Sep 03 11:32:23.751974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1313eaf-56a8-4473-b247-7e3c05e6fedf req-228534e9-4449-45a8-b1b1-e23689cd3497 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487347 Sep 03 11:32:23.906726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ccffc9-6d06-4290-8b3a-e8f756a14662 req-4e8eee4f-9689-46a0-9c0c-2a0c1223956c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:23.908228 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12ccffc9-6d06-4290-8b3a-e8f756a14662 req-4e8eee4f-9689-46a0-9c0c-2a0c1223956c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0498095 Sep 03 11:32:23.948626 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12ccffc9-6d06-4290-8b3a-e8f756a14662 req-d5420623-4db3-49a7-929d-7b50431a5836 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344985 Sep 03 11:32:24.091565 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6c5724c7-d0b6-4d40-b1d1-14812d56337f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:24.859800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35388) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:24.919450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d18187-38b1-46fb-9241-dd6051c1c833 req-79d615fd-5610-45f4-a8cf-27013262b891 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:24.921165 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-19d18187-38b1-46fb-9241-dd6051c1c833 req-79d615fd-5610-45f4-a8cf-27013262b891 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0960164 Sep 03 11:32:24.936383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead7cbf9-e9d9-4086-92ea-c5308837410b req-83c709e1-f05c-436c-ab0d-66fac15e9dbb tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:24.944001 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ead7cbf9-e9d9-4086-92ea-c5308837410b req-83c709e1-f05c-436c-ab0d-66fac15e9dbb tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0794277 Sep 03 11:32:24.984580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-041c6ee7-d471-4beb-bfae-2a5df29b2bd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.006969 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ead7cbf9-e9d9-4086-92ea-c5308837410b req-fb6cd62d-d49e-4a3b-a580-bdcbf6e3da4f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620260 Sep 03 11:32:25.021956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-19d18187-38b1-46fb-9241-dd6051c1c833 req-42f064ca-bac6-4bc0-8d1c-3a50dd1cc898 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758898 Sep 03 11:32:25.089325 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-041c6ee7-d471-4beb-bfae-2a5df29b2bd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.132207 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be12b528-a945-43ac-a90b-582ea7b00a85 req-ed2ab484-6050-422f-9b77-f467ea1152ba tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:25.133599 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be12b528-a945-43ac-a90b-582ea7b00a85 req-ed2ab484-6050-422f-9b77-f467ea1152ba tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0512838 Sep 03 11:32:25.154869 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-041c6ee7-d471-4beb-bfae-2a5df29b2bd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.187095 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-041c6ee7-d471-4beb-bfae-2a5df29b2bd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d28b4f4-3509-467d-9e1a-9628e18afdce,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:25.208363 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be12b528-a945-43ac-a90b-582ea7b00a85 req-bc75c3b6-d2b9-4132-abbf-0ea539793602 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677719 Sep 03 11:32:25.208959 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35394) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:25.217090 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-041c6ee7-d471-4beb-bfae-2a5df29b2bd9 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a7dde96595a04414820da7c24f53b48c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3508835 Sep 03 11:32:25.272184 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.294121 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.421742 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.424389 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:25.425527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7d28b4f4-3509-467d-9e1a-9628e18afdce HTTP/1.1" status: 204 len: 168 time: 0.2156532 Sep 03 11:32:25.434440 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-238cb8bb-5b55-409e-9716-0fc8d7b99fcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d28b4f4-3509-467d-9e1a-9628e18afdce,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:26.185356 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0d670a-8b8e-4952-9207-56b401120ab6 req-931f3506-f033-4e58-bf58-e2ad6f17bf2b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:26.187740 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd0d670a-8b8e-4952-9207-56b401120ab6 req-931f3506-f033-4e58-bf58-e2ad6f17bf2b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.1139951 Sep 03 11:32:26.223548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8080707-537a-4e64-8085-639822d7631e req-3bcba768-24fe-4da8-8a77-a10efe7ab40e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:26.231795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e8080707-537a-4e64-8085-639822d7631e req-3bcba768-24fe-4da8-8a77-a10efe7ab40e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1133699 Sep 03 11:32:26.278421 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd0d670a-8b8e-4952-9207-56b401120ab6 req-91e7f9c3-4a93-4b31-bfbe-5e1f72515f56 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834041 Sep 03 11:32:26.294740 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e8080707-537a-4e64-8085-639822d7631e req-9369c356-4582-481b-b4d0-08ba9d24329a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564358 Sep 03 11:32:26.338255 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-bf27d92e-3d0e-4f25-a9d0-6797389117bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:26.406658 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa89b8f-859d-4537-8044-969e3706403d req-ab63879a-1c2c-4ece-9b6c-b17689618d5c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:26.408499 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8fa89b8f-859d-4537-8044-969e3706403d req-ab63879a-1c2c-4ece-9b6c-b17689618d5c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0544038 Sep 03 11:32:26.447019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8fa89b8f-859d-4537-8044-969e3706403d req-f8cdcb4c-5d63-4f03-8ab7-88d158373f9a tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321827 Sep 03 11:32:26.914173 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:27.442163 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a8e2ac-5afc-4f86-a746-6c607001c179 req-ab1e05ac-8610-4c08-8af4-3f7e319f6762 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:27.443748 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77a8e2ac-5afc-4f86-a746-6c607001c179 req-ab1e05ac-8610-4c08-8af4-3f7e319f6762 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.0893500 Sep 03 11:32:27.451700 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1e6caa-4ae1-4149-92d0-7f5e9921094a req-7fd69b13-000b-4267-b04b-decea97ac38b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:27.453098 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c1e6caa-4ae1-4149-92d0-7f5e9921094a req-7fd69b13-000b-4267-b04b-decea97ac38b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0800083 Sep 03 11:32:27.512716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77a8e2ac-5afc-4f86-a746-6c607001c179 req-f2748dfe-179e-49d2-a148-070d6d6a6851 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585513 Sep 03 11:32:27.519894 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c1e6caa-4ae1-4149-92d0-7f5e9921094a req-614cd3a5-2533-4c60-ae24-d2c7f00a3e72 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590799 Sep 03 11:32:27.617509 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:27.636849 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b62b0d-ff2f-4b91-a640-cce745c9445b req-45af5fc5-1279-452b-b08f-8a01e64a8fa1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:27.638430 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1b62b0d-ff2f-4b91-a640-cce745c9445b req-45af5fc5-1279-452b-b08f-8a01e64a8fa1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0647933 Sep 03 11:32:27.657559 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35440) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:27.680136 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1b62b0d-ff2f-4b91-a640-cce745c9445b req-9d7a07bf-f21f-4f2d-b34b-2b5b31d3c421 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356784 Sep 03 11:32:27.775278 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0be24a0b-6bc1-4c74-9506-de6b51708de5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:27.870555 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0be24a0b-6bc1-4c74-9506-de6b51708de5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:27.971580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0be24a0b-6bc1-4c74-9506-de6b51708de5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:28.012867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be24a0b-6bc1-4c74-9506-de6b51708de5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e3eb7dc-f6e1-4481-b13c-ef4f683591c4,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:28.017287 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-0be24a0b-6bc1-4c74-9506-de6b51708de5 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=352acb240a1945dbaa0a020a4058f2ad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3587236 Sep 03 11:32:28.020002 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35444) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:28.074194 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:28.104517 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:28.239855 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:28.242535 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:28.247240 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1e3eb7dc-f6e1-4481-b13c-ef4f683591c4 HTTP/1.1" status: 204 len: 168 time: 0.2234607 Sep 03 11:32:28.253639 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531ed287-7c81-459a-ba1c-8b54ff042a44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e3eb7dc-f6e1-4481-b13c-ef4f683591c4,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:28.682258 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74121f95-3cc8-497b-a281-cdb57645b145 req-1b7802c6-18bf-4fdc-88d9-6d4a7bb2e589 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:28.684211 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-74121f95-3cc8-497b-a281-cdb57645b145 req-1b7802c6-18bf-4fdc-88d9-6d4a7bb2e589 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0900016 Sep 03 11:32:28.692698 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ab76d8-082f-4ce1-89b1-d578e5080c9a req-90db3d6a-c824-40b2-a82f-9ddbd392834b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:28.694110 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7ab76d8-082f-4ce1-89b1-d578e5080c9a req-90db3d6a-c824-40b2-a82f-9ddbd392834b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.1102071 Sep 03 11:32:28.751755 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-74121f95-3cc8-497b-a281-cdb57645b145 req-ff9876d3-cb83-4193-9084-8a93722344f1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565789 Sep 03 11:32:28.760341 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7ab76d8-082f-4ce1-89b1-d578e5080c9a req-7cda668e-b2cc-4169-94ad-289e59026f78 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589037 Sep 03 11:32:28.873281 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d238840-f588-4a99-9f95-29473ddb0b15 req-d1a957b3-51bf-4310-b8f3-19b5f75d6bbb tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:28.873281 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d238840-f588-4a99-9f95-29473ddb0b15 req-d1a957b3-51bf-4310-b8f3-19b5f75d6bbb tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.0551448 Sep 03 11:32:28.910956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d238840-f588-4a99-9f95-29473ddb0b15 req-a01ea579-0f31-4d38-894f-305d4892f563 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358424 Sep 03 11:32:29.033105 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:29.639540 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35476) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:29.642915 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Request body: {'port': {'device_id': '7f439798-36cf-4159-98d8-7530412a9647', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:29.644623 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Request body: {'port': {'device_id': '496f48b8-0710-41da-907b-a7938371e02d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:29.711134 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:29.711898 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:29.960843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-460288880-network', 'tenant_id': 'b669eeee0b744c35aee3612d15269920'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:30.013822 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:30.023715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.036145 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Transition to ACTIVE for port object 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:32:30.093334 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7863b3-b857-4dd5-8087-3f344554b3e3 req-783803f8-ff9d-4763-8cba-d9e7a66c96b5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.094826 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2c7863b3-b857-4dd5-8087-3f344554b3e3 req-783803f8-ff9d-4763-8cba-d9e7a66c96b5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1419463 Sep 03 11:32:30.114021 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.146221 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf44b2d8-19e8-4e1a-bb4d-07f948bce336 req-2c30341a-a136-4922-bc32-6065216571fc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.148067 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf44b2d8-19e8-4e1a-bb4d-07f948bce336 req-2c30341a-a136-4922-bc32-6065216571fc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 932 time: 0.1959267 Sep 03 11:32:30.161068 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Made reservation on behalf of b669eeee0b744c35aee3612d15269920 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:30.164142 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.181622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Pushing event updated for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:30.195706 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.230847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Attempting to bind port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:32:30.231109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Attempting to bind port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:32:30.231421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Attempting to bind port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:30.235648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:32:30.235950 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Attempting to bind port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c on network 778c15f4-3719-4d66-9e6d-1be38ac5cc42 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:30.240811 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 32, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:32:30.241147 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Checking segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:32:30.241523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Bound using segment: {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:32:30.241945 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Bound port: 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:32:30.242299 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.265883 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2c7863b3-b857-4dd5-8087-3f344554b3e3 req-d77c698e-68dc-4e86-b90a-a5341c782de0 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275237 Sep 03 11:32:30.268494 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf44b2d8-19e8-4e1a-bb4d-07f948bce336 req-13ca2c60-697f-4031-b474-f5e126ea1e52 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083016 Sep 03 11:32:30.312116 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:32:30.315890 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:32:30.412163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.450464 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.451081 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.452475 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] 10.222.0.11 "PUT /v2.0/ports/3f1d41ae-f270-4229-8991-c6a9aa7b7b6c HTTP/1.1" status: 200 len: 1094 time: 0.8168912 Sep 03 11:32:30.452914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:30.455196 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99179a51-7c3b-48f1-87a7-9314df948019" -d '{"events": [{"name": "network-changed", "server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:30.467430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b233ec38-66aa-4f03-a1c8-bd01df720b2a req-767b4a57-4077-4d7d-98b0-e6f65f8792fc tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.468983 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b233ec38-66aa-4f03-a1c8-bd01df720b2a req-767b4a57-4077-4d7d-98b0-e6f65f8792fc tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 932 time: 0.1240504 Sep 03 11:32:30.487584 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d0354e-4625-40a2-bc11-06a5d0e57b99 service neutron] Pushing event updated for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:30.493982 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64bbf37b-4085-4a6a-a5a7-9ec93effec90 x-openstack-request-id: req-64bbf37b-4085-4a6a-a5a7-9ec93effec90 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:30.494411 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:30.494730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-64bbf37b-4085-4a6a-a5a7-9ec93effec90 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:30.495687 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c', 'status': 'completed', 'code': 200} Sep 03 11:32:30.506599 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0c1a0140-6eb6-4bae-ba93-b742e42fed8e {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:30.512360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.518765 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.542613 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Transition to ACTIVE for port object 0c1a0140-6eb6-4bae-ba93-b742e42fed8e will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:32:30.545881 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b233ec38-66aa-4f03-a1c8-bd01df720b2a req-6b8ba26c-a98d-4a4b-9c4b-6c00cdff1776 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699654 Sep 03 11:32:30.561106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99179a51-7c3b-48f1-87a7-9314df948019 req-698655c4-558a-4d4d-a76e-8557df53df51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.564926 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99179a51-7c3b-48f1-87a7-9314df948019 req-698655c4-558a-4d4d-a76e-8557df53df51 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 1097 time: 0.0423081 Sep 03 11:32:30.605428 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.625135 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] vlan segment allocate from pool success with {'vlan_id': 364, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:32:30.629265 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.666974 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99179a51-7c3b-48f1-87a7-9314df948019 req-afe69eb7-4324-4c5b-8a46-082f931b7e04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.668436 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99179a51-7c3b-48f1-87a7-9314df948019 req-afe69eb7-4324-4c5b-8a46-082f931b7e04 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0960031 Sep 03 11:32:30.680087 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.680087 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Added segment 06ffc106-b4b7-4f79-867c-120424c01651 of type vlan for network 82386b1b-1e2a-418d-8be9-a666ddcb7220 Sep 03 11:32:30.682305 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e7f4935-56b1-4330-857f-c652c7c14ed1,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:30.773706 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99179a51-7c3b-48f1-87a7-9314df948019 req-f589aaac-734b-44ce-ae1f-271b2b14310f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.775814 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99179a51-7c3b-48f1-87a7-9314df948019 req-f589aaac-734b-44ce-ae1f-271b2b14310f service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0980294 Sep 03 11:32:30.779789 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:30.786685 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.836031 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Attempting to bind port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:32:30.836031 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Attempting to bind port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:32:30.836031 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Attempting to bind port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e on network f39e51e6-3ab9-4955-9302-06484ab5c362 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:30.837536 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e on network f39e51e6-3ab9-4955-9302-06484ab5c362 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:32:30.837850 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Attempting to bind port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e on network f39e51e6-3ab9-4955-9302-06484ab5c362 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:30.843344 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 32, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:32:30.843687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Checking segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:32:30.844092 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Bound using segment: {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:32:30.844520 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Bound port: 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:32:30.844888 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.866676 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-a6d382fe-247a-4e3e-8bef-67701a3425e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.868784 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-a6d382fe-247a-4e3e-8bef-67701a3425e4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 1097 time: 0.0493133 Sep 03 11:32:30.887814 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.888797 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.889376 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:30.913355 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-ac226911-4bb7-4d7b-a9b6-a447428411c0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c HTTP/1.1" status: 200 len: 217 time: 0.0340588 Sep 03 11:32:30.968319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-d68388bc-45e1-4edb-8521-ddb69dd87fdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:30.969826 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-d68388bc-45e1-4edb-8521-ddb69dd87fdc service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0463297 Sep 03 11:32:30.969963 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] Pushing event updated for resources: {'Network': ['ID=82386b1b-1e2a-418d-8be9-a666ddcb7220,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:30.979632 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:32:30.997447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bfc7d717-0f94-496e-8979-3c22d51678aa admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.3565559 Sep 03 11:32:31.000157 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35492) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:31.005281 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Request body: {'subnet': {'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-460288880-subnet', 'tenant_id': 'b669eeee0b744c35aee3612d15269920', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:31.008816 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:32:31.013378 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-c0d72220-648e-4dac-9bfb-65b3010ae7de service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294785 Sep 03 11:32:31.026635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:32:31.090444 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:31.104537 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-ed83df96-1fda-414c-ac5f-62e1b441143a service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861211 Sep 03 11:32:31.124547 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Made reservation on behalf of b669eeee0b744c35aee3612d15269920 for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:31.126805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:31.131556 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.132558 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:31.133544 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] 10.222.0.11 "PUT /v2.0/ports/0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 1094 time: 1.4976044 Sep 03 11:32:31.134619 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:31.137043 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d228dd5-09a7-419b-afd8-3b4689ce65b9" -d '{"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:31.182488 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e685f6-c27d-45e9-b117-bf2661187bf9 service neutron] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:31.216918 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fba4f898-6289-4465-beaa-67681e42dac9 x-openstack-request-id: req-fba4f898-6289-4465-beaa-67681e42dac9 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:31.217203 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:31.217451 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-fba4f898-6289-4465-beaa-67681e42dac9 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:31.217842 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:32:31.232257 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b96a82b-10d4-48db-88aa-addc498e56b4 req-2bbec351-86d4-4d92-b76e-3cb53dcd3c78 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1187108 Sep 03 11:32:31.299051 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-e741775c-ecb8-4c3c-bf9d-21903ceb3acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.300466 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-e741775c-ecb8-4c3c-bf9d-21903ceb3acf service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1097 time: 0.0435624 Sep 03 11:32:31.392093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:31.432321 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-bb55413f-3654-4fe0-a91f-72ea40a2ee61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.433819 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-bb55413f-3654-4fe0-a91f-72ea40a2ee61 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=a929f96c596b45e78449a64936959efe&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1184950 Sep 03 11:32:31.468558 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5923d69-287c-4b1e-9afd-95e1674c8724 req-91f40485-b4f3-437d-80b6-4f0d71b7d663 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.470084 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a5923d69-287c-4b1e-9afd-95e1674c8724 req-91f40485-b4f3-437d-80b6-4f0d71b7d663 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.1211886 Sep 03 11:32:31.512185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec677dc7-1355-4cea-b2d3-a4ec12c5b02f req-f3f1e319-0fd8-476c-a2a2-edeb4d231133 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.513595 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec677dc7-1355-4cea-b2d3-a4ec12c5b02f req-f3f1e319-0fd8-476c-a2a2-edeb4d231133 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 944 time: 0.1380489 Sep 03 11:32:31.514202 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=44fde28d-267c-4bed-b76b-3cabf5dda5a8,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:31.533523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-7a894e51-1261-4c8d-b1bc-334d303df160 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.535010 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-4d228dd5-09a7-419b-afd8-3b4689ce65b9 req-7a894e51-1261-4c8d-b1bc-334d303df160 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0907569 Sep 03 11:32:31.555222 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Checking segment: {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:32:31.555580 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Network hostable DHCP agents. Network: 82386b1b-1e2a-418d-8be9-a666ddcb7220, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:32:31.561051 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a5923d69-287c-4b1e-9afd-95e1674c8724 req-46b1c8f5-143a-4e5e-bd00-f696903a2fa2 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843351 Sep 03 11:32:31.587985 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec677dc7-1355-4cea-b2d3-a4ec12c5b02f req-9d4d757e-a682-49ee-9564-976674c0fbd7 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650940 Sep 03 11:32:31.618137 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-1b028a2b-ff68-480e-bf46-f5754e15cf58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.619896 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-1b028a2b-ff68-480e-bf46-f5754e15cf58 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1097 time: 0.0431125 Sep 03 11:32:31.668634 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-05a7c7a2-bc4f-4ac2-9533-861d22637b48 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 217 time: 0.0376356 Sep 03 11:32:31.673810 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76f4d86-6fe8-4031-91f9-0ed59a13a8e6 req-0c67b7ad-ccca-42c0-a855-001dda646175 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.676527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f76f4d86-6fe8-4031-91f9-0ed59a13a8e6 req-0c67b7ad-ccca-42c0-a855-001dda646175 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 944 time: 0.0489743 Sep 03 11:32:31.676527 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:32:31.715539 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f76f4d86-6fe8-4031-91f9-0ed59a13a8e6 req-518f2888-dccf-4863-b0c2-f2105399be36 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330529 Sep 03 11:32:31.721258 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-9e20bc59-fdd8-4e4c-a6eb-5538f7d34e4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.722735 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-9e20bc59-fdd8-4e4c-a6eb-5538f7d34e4f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0454397 Sep 03 11:32:31.765227 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 82386b1b-1e2a-418d-8be9-a666ddcb7220) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:31.769338 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.771907 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:31.772647 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-37d0587b-95dc-4b9e-8215-915adb0dcc87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:31.774353 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-37d0587b-95dc-4b9e-8215-915adb0dcc87 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0438104 Sep 03 11:32:31.775058 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e01932a-0af3-4b92-9ce3-f5692a97def6 None None] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:32:31.851377 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f983b191-c6f9-4600-b527-8e0fc83f68a0 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.8500080 Sep 03 11:32:31.882265 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-6b9f230a-53f1-4fb3-957d-64116948267f service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0930319 Sep 03 11:32:31.901456 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfe30f95-ca4d-4479-89e9-5f988445614e None None] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:32:31.979399 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d8a4f0cb-d4eb-41b1-9125-950159ddc66c req-676634c9-58de-45e6-bf02-630a298f395d service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873320 Sep 03 11:32:32.686215 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467d5a1f-5393-4158-aca9-9957451363f1 req-98939801-291a-4ed3-b406-6776d6ff7a88 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:32.687733 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-467d5a1f-5393-4158-aca9-9957451363f1 req-98939801-291a-4ed3-b406-6776d6ff7a88 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0602620 Sep 03 11:32:32.751155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e288dcb7-1c24-4b55-9d70-7a01bd3c9f01 req-eb18e19d-6785-4484-b1a7-668ef101cb82 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:32.754423 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e288dcb7-1c24-4b55-9d70-7a01bd3c9f01 req-eb18e19d-6785-4484-b1a7-668ef101cb82 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 944 time: 0.0872998 Sep 03 11:32:32.755698 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-467d5a1f-5393-4158-aca9-9957451363f1 req-5e6488cd-64d3-42b9-91b1-0c230f9d5239 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539377 Sep 03 11:32:32.794534 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e288dcb7-1c24-4b55-9d70-7a01bd3c9f01 req-ab477bf0-c9a3-466e-b11b-c7bbac31cd8a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359881 Sep 03 11:32:32.859245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659587f2-788d-40f8-8f3d-d5473be27e55 req-4bf112d6-d9e2-4fab-8a44-b00653c3bb10 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:32.860715 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-659587f2-788d-40f8-8f3d-d5473be27e55 req-4bf112d6-d9e2-4fab-8a44-b00653c3bb10 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 944 time: 0.0486510 Sep 03 11:32:32.898858 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-659587f2-788d-40f8-8f3d-d5473be27e55 req-f46cfece-3398-4355-8f0c-4011cdfaa39b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322134 Sep 03 11:32:33.637133 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:32:33.731830 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:33.742867 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c', 'network_id': '778c15f4-3719-4d66-9e6d-1be38ac5cc42', 'port_id': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c', 'mac_address': 'fa:16:3e:d8:11:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c64b6662-4e29-47d5-96b7-4719ce1edb33', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:32:33.779887 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:33.797025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:33.819970 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:33.877566 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fda60ebc-ea18-4b66-b593-cd8a790b9cb0 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:33.878997 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fda60ebc-ea18-4b66-b593-cd8a790b9cb0 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/networks?id=82386b1b-1e2a-418d-8be9-a666ddcb7220 HTTP/1.1" status: 200 len: 808 time: 0.1310711 Sep 03 11:32:33.891172 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:33.898322 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-0f76c096-e476-4c0b-9c3f-ad5bb3c2dd5c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/quotas/b669eeee0b744c35aee3612d15269920 HTTP/1.1" status: 200 len: 375 time: 0.0131292 Sep 03 11:32:33.907997 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd81c2ac-37a6-4ada-8184-0897711ebf90 req-87970cd5-3906-4d3d-b508-7357a62883b3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:33.908597 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd81c2ac-37a6-4ada-8184-0897711ebf90 req-87970cd5-3906-4d3d-b508-7357a62883b3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0785215 Sep 03 11:32:33.940409 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-2683af92-c254-4595-84bc-4552b881e9e2 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0308633 Sep 03 11:32:33.941694 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:33.949390 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.949742 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.950087 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.950454 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.950923 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.951264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.951596 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.951927 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.952282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.952618 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.952945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.953269 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:33.989527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd81c2ac-37a6-4ada-8184-0897711ebf90 req-0ef2c83c-e882-4259-9761-d9164129bce6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699258 Sep 03 11:32:34.049082 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-c0486893-9147-4377-a6b2-5716f3177859 service neutron] 10.222.0.16 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1005211 Sep 03 11:32:34.157213 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae18c578-9e80-42dc-b59c-e23c3ba39eb2 req-0903ad9c-d451-4333-8ec9-b17781f3a8a0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:34.158608 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ae18c578-9e80-42dc-b59c-e23c3ba39eb2 req-0903ad9c-d451-4333-8ec9-b17781f3a8a0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 945 time: 0.1066546 Sep 03 11:32:34.186045 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-1c68e796-68e5-4329-8fed-8e4d588ee5a0 service neutron] 10.222.0.16 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1252949 Sep 03 11:32:34.205235 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ae18c578-9e80-42dc-b59c-e23c3ba39eb2 req-1c0bf956-ecad-42b3-9f03-74321ce364c6 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407603 Sep 03 11:32:34.216608 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['3f1d41ae-f270-4229-8991-c6a9aa7b7b6c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:34.313740 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1f4db7-8f68-496e-a6df-8b5f4c324e3d req-b4f4d1ec-9525-455d-be18-ce26834f455e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:34.315367 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef1f4db7-8f68-496e-a6df-8b5f4c324e3d req-b4f4d1ec-9525-455d-be18-ce26834f455e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 944 time: 0.0492637 Sep 03 11:32:34.353600 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef1f4db7-8f68-496e-a6df-8b5f4c324e3d req-edb0aaf7-9c8b-455c-9f04-abb407ed9f28 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317302 Sep 03 11:32:34.466354 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8fd8b8b6-c0f3-4b91-be76-e6dc3d4944af req-4a4d7233-19a8-4225-a005-4d688e869d13 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 210 time: 0.0256345 Sep 03 11:32:35.105626 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531d02a9-87c6-42e6-a599-669e115a0fd5 req-0f4a0f3b-f36a-4e1b-9451-112724e2575e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:35.107144 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-531d02a9-87c6-42e6-a599-669e115a0fd5 req-0f4a0f3b-f36a-4e1b-9451-112724e2575e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0522499 Sep 03 11:32:35.144234 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-531d02a9-87c6-42e6-a599-669e115a0fd5 req-9ba3d85b-b31a-431a-b5ba-ced5dcb51d4b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311644 Sep 03 11:32:35.320254 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb20e15-00c5-43cb-80a6-0e90963b0512 req-2159ee3a-c86d-44d5-8cd7-a4261545f1f8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:35.321671 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1bb20e15-00c5-43cb-80a6-0e90963b0512 req-2159ee3a-c86d-44d5-8cd7-a4261545f1f8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 945 time: 0.0486250 Sep 03 11:32:35.360449 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1bb20e15-00c5-43cb-80a6-0e90963b0512 req-e99bbf93-694f-4362-9313-7a97d151df4e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328887 Sep 03 11:32:35.470612 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de232c3-459e-476d-87d3-cae412b90998 req-ac144660-90ce-48fa-ad1c-0a687ffb1b83 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:35.474515 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0de232c3-459e-476d-87d3-cae412b90998 req-ac144660-90ce-48fa-ad1c-0a687ffb1b83 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 944 time: 0.0499175 Sep 03 11:32:35.512254 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0de232c3-459e-476d-87d3-cae412b90998 req-238d2b73-66c3-4112-baa9-ed40b1300f36 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335302 Sep 03 11:32:35.563548 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-741b1c51-f65d-4fe4-b795-fb025d58fe93 req-23061f33-51b0-4291-a39b-f35f0140ff55 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 210 time: 0.0301330 Sep 03 11:32:35.640173 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0c1a0140-6eb6-4bae-ba93-b742e42fed8e details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:32:35.643270 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:35.775655 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:35.786600 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'port_id': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'mac_address': 'fa:16:3e:80:56:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:32:35.827456 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:35.830262 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:35.841994 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:35.842357 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:35.845643 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0c1a0140-6eb6-4bae-ba93-b742e42fed8e {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:35.891373 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:35.938517 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:35.961327 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:35.964423 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5db6f6c1-5f01-4f74-a148-0d5626187d81" -d '{"events": [{"server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "name": "network-vif-plugged", "status": "completed", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:35.977553 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:35.984100 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:36.003863 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b861fd4e-88cd-49df-9d2a-8efefed93705 x-openstack-request-id: req-b861fd4e-88cd-49df-9d2a-8efefed93705 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:36.004599 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "name": "network-vif-plugged", "status": "completed", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:36.004847 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b861fd4e-88cd-49df-9d2a-8efefed93705 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:36.005228 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c', 'code': 200} Sep 03 11:32:36.033615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:36.102522 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:36.150048 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:36.259707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e7bbd3-2ddb-4bef-a8c5-6093e1970913 req-a9bf580b-6ba4-4318-8795-9fd62d024871 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:36.261300 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1e7bbd3-2ddb-4bef-a8c5-6093e1970913 req-a9bf580b-6ba4-4318-8795-9fd62d024871 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0486631 Sep 03 11:32:36.297995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:36.305244 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1e7bbd3-2ddb-4bef-a8c5-6093e1970913 req-22572b6e-8fe2-46d9-b6c3-9aa7e1318896 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377932 Sep 03 11:32:36.388258 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edc7e3b-155b-4d30-b3dc-12d4fbce68f6 req-b0e4d096-2e9f-4c8d-b178-258f9d699ebc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:36.390106 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8edc7e3b-155b-4d30-b3dc-12d4fbce68f6 req-b0e4d096-2e9f-4c8d-b178-258f9d699ebc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 1099 time: 0.0460310 Sep 03 11:32:36.432297 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-7f34db3a-da39-4789-8381-b191d219c7bc tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:36.434240 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-7f34db3a-da39-4789-8381-b191d219c7bc tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "GET /v2.0/networks?id=82386b1b-1e2a-418d-8be9-a666ddcb7220 HTTP/1.1" status: 200 len: 808 time: 0.1396892 Sep 03 11:32:36.451102 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Request body: {'port': {'device_id': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220', 'admin_state_up': True, 'tenant_id': 'b669eeee0b744c35aee3612d15269920'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:36.453966 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8edc7e3b-155b-4d30-b3dc-12d4fbce68f6 req-4ebc098f-f615-4698-982c-8b182449b19d service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559602 Sep 03 11:32:36.495084 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0bb93be-7e7a-43e8-bef6-5f91de7f9611 req-f8c11aff-bbd0-4cc0-b1c4-48cc2e0fc06c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:36.496616 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d0bb93be-7e7a-43e8-bef6-5f91de7f9611 req-f8c11aff-bbd0-4cc0-b1c4-48cc2e0fc06c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.0531785 Sep 03 11:32:36.538904 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d0bb93be-7e7a-43e8-bef6-5f91de7f9611 req-351d9e8c-3796-4e7e-9fb3-42f09909bf78 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362875 Sep 03 11:32:36.622682 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Made reservation on behalf of b669eeee0b744c35aee3612d15269920 for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:36.626722 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:36.637080 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33837045-03af-4dad-9967-0ccc7fa2870f req-256637cd-4981-4433-bb6d-4638cf83e73f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:36.638786 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33837045-03af-4dad-9967-0ccc7fa2870f req-256637cd-4981-4433-bb6d-4638cf83e73f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 945 time: 0.0495031 Sep 03 11:32:36.675159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-62fd134c-f652-4cb5-9f6d-c64e36905519 req-1b5626fa-8d3b-4e97-a966-8687d9ab70ef tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 210 time: 0.0354583 Sep 03 11:32:36.696494 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33837045-03af-4dad-9967-0ccc7fa2870f req-ff4488fd-d886-44e0-81fb-464227876fa5 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479105 Sep 03 11:32:36.767719 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Allocated IP 172.20.0.13 (82386b1b-1e2a-418d-8be9-a666ddcb7220/44fde28d-267c-4bed-b76b-3cabf5dda5a8/899e44c5-355a-4338-a2c9-3e4bfe86e3be) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:32:36.918589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.057453 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.097746 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:32:37.100825 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:37.107128 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:32:37.115359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Pushing event updated for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:37.158545 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.159075 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.228109 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fbc95029-4e94-4aa6-83bd-db34eda5c700 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7810013 Sep 03 11:32:37.242103 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Request body: {'port': {'device_id': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:37.297581 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.426433 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b080c5d-a4e4-4b8d-b6ba-caba0f828a95 req-ab8d3c81-0d2e-49f9-8643-fff060347568 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.427927 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b080c5d-a4e4-4b8d-b6ba-caba0f828a95 req-ab8d3c81-0d2e-49f9-8643-fff060347568 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0507019 Sep 03 11:32:37.466916 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b080c5d-a4e4-4b8d-b6ba-caba0f828a95 req-0438f9cc-b305-4e92-9498-a0937d6d2de6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324659 Sep 03 11:32:37.559180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 899e44c5-355a-4338-a2c9-3e4bfe86e3be {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:37.566802 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.578503 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Transition to ACTIVE for port object 899e44c5-355a-4338-a2c9-3e4bfe86e3be will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:32:37.639889 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.645969 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0c1a0140-6eb6-4bae-ba93-b742e42fed8e up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:37.656619 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc40306-521b-4afe-8696-df5825e95b13 req-8efcfcb1-1e76-4c63-8d4b-d7eeba3624ee tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.658201 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8dc40306-521b-4afe-8696-df5825e95b13 req-8efcfcb1-1e76-4c63-8d4b-d7eeba3624ee tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.0535161 Sep 03 11:32:37.702933 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8dc40306-521b-4afe-8696-df5825e95b13 req-05ffc684-9728-4ed9-a15a-5dfdac5aedab tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378771 Sep 03 11:32:37.713534 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Pushing event updated for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:37.760696 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:37.765054 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:37.765559 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.779860 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Attempting to bind port 899e44c5-355a-4338-a2c9-3e4bfe86e3be on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:32:37.783258 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Attempting to bind port 899e44c5-355a-4338-a2c9-3e4bfe86e3be by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:32:37.783258 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Attempting to bind port 899e44c5-355a-4338-a2c9-3e4bfe86e3be on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:37.786042 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Port 899e44c5-355a-4338-a2c9-3e4bfe86e3be on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:32:37.786411 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Attempting to bind port 899e44c5-355a-4338-a2c9-3e4bfe86e3be on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:37.796342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 32, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:32:37.796688 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Checking segment: {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:32:37.797075 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Bound using segment: {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:32:37.797513 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Bound port: 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:32:37.797877 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.853872 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025ca2c8-b718-499b-85f0-3ac4b4eee66c req-6ce50cb3-776e-487d-a9f6-6affa7c49251 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.856072 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-025ca2c8-b718-499b-85f0-3ac4b4eee66c req-6ce50cb3-776e-487d-a9f6-6affa7c49251 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 944 time: 0.0739284 Sep 03 11:32:37.860551 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.887663 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387ffa2e-9ed9-45c5-af16-63e072874478 req-f9e6be90-149a-45ad-a3ba-e832ad3412ab tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.889616 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-387ffa2e-9ed9-45c5-af16-63e072874478 req-f9e6be90-149a-45ad-a3ba-e832ad3412ab tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 945 time: 0.1181109 Sep 03 11:32:37.891122 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:32:37.894481 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:32:37.908890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:37.925738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-025ca2c8-b718-499b-85f0-3ac4b4eee66c req-a27747ba-a0ae-4a9b-a4fa-ad740ef666ce tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622790 Sep 03 11:32:37.945479 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-387ffa2e-9ed9-45c5-af16-63e072874478 req-a64aab55-b14e-4907-80c6-4f94c6c04f90 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465903 Sep 03 11:32:37.949158 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.975759 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.987736 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:37.988106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:37.989498 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] 10.222.0.11 "PUT /v2.0/ports/899e44c5-355a-4338-a2c9-3e4bfe86e3be HTTP/1.1" status: 200 len: 1094 time: 0.7516236 Sep 03 11:32:37.989933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:37.992293 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698" -d '{"events": [{"name": "network-changed", "server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:38.008126 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:38.010122 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49b46075-14d7-4788-ba37-c231cf945675" -d '{"events": [{"server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "name": "network-vif-plugged", "status": "completed", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:38.016652 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25096359-e6b4-4df7-9f27-f506b27637e1 service neutron] Pushing event updated for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:38.036394 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4da39130-2075-4b83-b621-6c4bfb1350ce x-openstack-request-id: req-4da39130-2075-4b83-b621-6c4bfb1350ce {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:38.036687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:38.036939 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4da39130-2075-4b83-b621-6c4bfb1350ce {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:38.037345 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be', 'status': 'completed', 'code': 200} Sep 03 11:32:38.053399 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:38.059926 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a9da87c-4e9d-41c1-bb5f-039e557b03a4 x-openstack-request-id: req-5a9da87c-4e9d-41c1-bb5f-039e557b03a4 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:38.060210 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "name": "network-vif-plugged", "status": "completed", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:38.060459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-5a9da87c-4e9d-41c1-bb5f-039e557b03a4 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:38.060894 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'code': 200} Sep 03 11:32:38.112052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-00ed7144-9546-4208-b394-74ceba4b229c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.113570 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-00ed7144-9546-4208-b394-74ceba4b229c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 1097 time: 0.0411637 Sep 03 11:32:38.253234 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-037739bd-000c-43e1-b76a-abd071ee5fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.254644 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-037739bd-000c-43e1-b76a-abd071ee5fbe service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=b669eeee0b744c35aee3612d15269920&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1027582 Sep 03 11:32:38.341336 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43977a35-3c1b-4ba5-b677-aabb2e3f7f82 req-b4d16c13-e88e-49b0-bbab-57574019e641 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.342922 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43977a35-3c1b-4ba5-b677-aabb2e3f7f82 req-b4d16c13-e88e-49b0-bbab-57574019e641 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1099 time: 0.0421600 Sep 03 11:32:38.381403 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43977a35-3c1b-4ba5-b677-aabb2e3f7f82 req-d259e063-76c8-412e-ad6e-610d21c8d79f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303302 Sep 03 11:32:38.555330 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-0616256e-6202-4eab-be1d-9670a7315ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.557342 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b9f05f7d-4d95-4166-9167-5c3ffd2b0698 req-0616256e-6202-4eab-be1d-9670a7315ed0 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2927063 Sep 03 11:32:38.581707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d30c26-d8a5-4778-a736-d6829301b03a req-bd22616d-8b66-4c33-8ea7-fe7009bee395 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.583246 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f4d30c26-d8a5-4778-a736-d6829301b03a req-bd22616d-8b66-4c33-8ea7-fe7009bee395 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0487192 Sep 03 11:32:38.622894 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f4d30c26-d8a5-4778-a736-d6829301b03a req-f23d2297-97ad-41e1-adb1-1bc4ed369a43 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327573 Sep 03 11:32:38.653575 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-73edf695-a5ce-404e-86df-81c8a2a084b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.655092 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-73edf695-a5ce-404e-86df-81c8a2a084b5 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 1097 time: 0.0396392 Sep 03 11:32:38.703199 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-fded118a-8429-41df-bea1-289d36b4471e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be HTTP/1.1" status: 200 len: 217 time: 0.0364344 Sep 03 11:32:38.754869 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd6f509-7f97-4771-8713-3566217f2edb req-696f98f8-6f79-4b91-a18d-3a779ddd76bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.756365 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-696f98f8-6f79-4b91-a18d-3a779ddd76bc service neutron] 10.222.0.11 "GET /v2.0/subnets?id=44fde28d-267c-4bed-b76b-3cabf5dda5a8 HTTP/1.1" status: 200 len: 848 time: 0.0453134 Sep 03 11:32:38.798656 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-274921c0-7783-4c06-a894-1567b8ff2b24 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=82386b1b-1e2a-418d-8be9-a666ddcb7220&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250022 Sep 03 11:32:38.819822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea61fd2b-a3cb-47c4-9c56-1c0f0b5c657c req-f887ab1d-dc8a-4402-b994-5c9ed24964ea tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:38.821181 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea61fd2b-a3cb-47c4-9c56-1c0f0b5c657c req-f887ab1d-dc8a-4402-b994-5c9ed24964ea tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.0479324 Sep 03 11:32:38.862127 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea61fd2b-a3cb-47c4-9c56-1c0f0b5c657c req-34ec2d3c-cb79-43d2-99e4-e5c30a222c37 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341227 Sep 03 11:32:38.898317 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-ad2d0453-c49e-4a68-bc79-158e2ebd19e6 service neutron] 10.222.0.11 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863767 Sep 03 11:32:39.012166 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8cd6f509-7f97-4771-8713-3566217f2edb req-3bc33da6-e83f-4e39-9951-3994b747e0d9 service neutron] 10.222.0.11 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0973063 Sep 03 11:32:39.077718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640a746a-8806-42db-8d66-ee87d1fa3782 req-e37d9290-8c54-4da8-a19e-4780caaccec5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:39.079184 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-640a746a-8806-42db-8d66-ee87d1fa3782 req-e37d9290-8c54-4da8-a19e-4780caaccec5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 944 time: 0.0781474 Sep 03 11:32:39.117095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cea3884-5633-4147-b254-5a73cf1fc9a2 req-d82b32a0-dd8c-42c4-97dd-dfc052154d82 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:39.118686 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4cea3884-5633-4147-b254-5a73cf1fc9a2 req-d82b32a0-dd8c-42c4-97dd-dfc052154d82 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0793698 Sep 03 11:32:39.138218 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-640a746a-8806-42db-8d66-ee87d1fa3782 req-e8e6696b-cf1d-427f-9e38-ee16437b1994 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529830 Sep 03 11:32:39.164280 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4cea3884-5633-4147-b254-5a73cf1fc9a2 req-52ea200c-cc50-4113-9958-42b474533b04 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386229 Sep 03 11:32:39.735457 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff240e1-9293-4bcd-924d-f99be1bbe84d req-98e1c328-8e50-44e6-8d61-54df6fe206dd tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:39.736957 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9ff240e1-9293-4bcd-924d-f99be1bbe84d req-98e1c328-8e50-44e6-8d61-54df6fe206dd tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0489197 Sep 03 11:32:39.778951 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9ff240e1-9293-4bcd-924d-f99be1bbe84d req-e5081e7c-e0ac-4e1c-ba99-18221a916208 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359013 Sep 03 11:32:40.277528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a00711c-6edf-4d72-b865-320007ef18b2 req-2d9a7fe5-c1d0-49cd-a481-0d6aa4cff466 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:40.279025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6a00711c-6edf-4d72-b865-320007ef18b2 req-2d9a7fe5-c1d0-49cd-a481-0d6aa4cff466 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 944 time: 0.0722067 Sep 03 11:32:40.301264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6c40e9-4879-43a0-8d63-16f70c928db7 req-39d8a053-5f02-436c-be28-9fb51cc95623 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:40.302678 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac6c40e9-4879-43a0-8d63-16f70c928db7 req-39d8a053-5f02-436c-be28-9fb51cc95623 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0700800 Sep 03 11:32:40.343794 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6a00711c-6edf-4d72-b865-320007ef18b2 req-3fccf943-f161-4015-94c1-dac18cf8da34 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585921 Sep 03 11:32:40.356666 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac6c40e9-4879-43a0-8d63-16f70c928db7 req-3b83ea8c-8d1f-4639-9565-6bf8fcd63eba tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470340 Sep 03 11:32:40.487913 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39465ee1-19d0-437a-b4c9-0b0eb44e3271 req-6eb5b9c8-e96d-4e85-bade-54d33ab9919d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:40.489620 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39465ee1-19d0-437a-b4c9-0b0eb44e3271 req-6eb5b9c8-e96d-4e85-bade-54d33ab9919d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0650008 Sep 03 11:32:40.528993 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39465ee1-19d0-437a-b4c9-0b0eb44e3271 req-af503c93-3a1f-403f-9a81-abca655a3fa3 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326693 Sep 03 11:32:40.863122 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725574aa-2fe7-47d0-b125-4591100898cd req-bdc77a87-5075-4fbd-8e4a-167958a127e1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:40.864587 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-725574aa-2fe7-47d0-b125-4591100898cd req-bdc77a87-5075-4fbd-8e4a-167958a127e1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0485284 Sep 03 11:32:40.903738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-725574aa-2fe7-47d0-b125-4591100898cd req-7ef19726-bdd2-4422-a9f5-ca124b856d7a tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323820 Sep 03 11:32:41.007415 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e985e95-a829-429f-bc59-90157a3badf1 req-81f7a757-5eca-428a-9858-72aa5d9ad5e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:41.009456 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e985e95-a829-429f-bc59-90157a3badf1 req-81f7a757-5eca-428a-9858-72aa5d9ad5e8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0496116 Sep 03 11:32:41.048265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e985e95-a829-429f-bc59-90157a3badf1 req-da653e08-791f-4e45-a109-2312bc5cbade tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324230 Sep 03 11:32:41.467590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9147bd-4f16-4857-9e34-0be12f0ad219 req-3c675f42-0645-47e6-9a99-c336a5cffee7 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:41.469025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4c9147bd-4f16-4857-9e34-0be12f0ad219 req-3c675f42-0645-47e6-9a99-c336a5cffee7 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 944 time: 0.0554543 Sep 03 11:32:41.523581 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4c9147bd-4f16-4857-9e34-0be12f0ad219 req-c489b26a-6b5e-4aa9-a846-fac7cb331190 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446835 Sep 03 11:32:41.580455 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f3f6e40-94a1-497a-b8a8-f1be33b0263f req-e4baebf3-e90d-4971-a22e-9f3cce1ddc02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:41.581966 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-2f3f6e40-94a1-497a-b8a8-f1be33b0263f req-e4baebf3-e90d-4971-a22e-9f3cce1ddc02 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 1098 time: 0.0453391 Sep 03 11:32:41.620734 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-2f3f6e40-94a1-497a-b8a8-f1be33b0263f req-e249da9c-59b2-4443-a1e7-82a3f7cc1a1c service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0286384 Sep 03 11:32:41.652933 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 899e44c5-355a-4338-a2c9-3e4bfe86e3be details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:32:41.745997 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:41.757255 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '899e44c5-355a-4338-a2c9-3e4bfe86e3be', 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220', 'port_id': '899e44c5-355a-4338-a2c9-3e4bfe86e3be', 'mac_address': 'fa:16:3e:5f:31:d0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 364, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '44fde28d-267c-4bed-b76b-3cabf5dda5a8', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:32:41.798095 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:41.810705 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 899e44c5-355a-4338-a2c9-3e4bfe86e3be {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:41.830277 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:41.897444 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:41.943755 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:42.164089 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b72daca-b212-41ad-934c-b066f5ede52c req-bcc28c4d-b345-41d4-8984-f1dc150b1861 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:42.166464 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3b72daca-b212-41ad-934c-b066f5ede52c req-bcc28c4d-b345-41d4-8984-f1dc150b1861 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0498352 Sep 03 11:32:42.205802 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3b72daca-b212-41ad-934c-b066f5ede52c req-43cc499b-9cc9-433f-8226-afa78916a309 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333316 Sep 03 11:32:42.309356 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['899e44c5-355a-4338-a2c9-3e4bfe86e3be'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:42.640429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87a778e-6571-4fcf-96ac-e36f7c9e6674 req-10d2043d-67c6-4197-8eb7-f70d34fb8c10 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:42.641954 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f87a778e-6571-4fcf-96ac-e36f7c9e6674 req-10d2043d-67c6-4197-8eb7-f70d34fb8c10 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 945 time: 0.0496142 Sep 03 11:32:42.681266 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f87a778e-6571-4fcf-96ac-e36f7c9e6674 req-d4695fce-c23a-4b56-9130-0e95033ee4f3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329635 Sep 03 11:32:43.325325 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc5e34e-4f42-4e16-a1e0-b723470b0a7c req-b452110b-826c-4c3a-addf-fd083a21b75b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:43.326898 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dc5e34e-4f42-4e16-a1e0-b723470b0a7c req-b452110b-826c-4c3a-addf-fd083a21b75b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0524361 Sep 03 11:32:43.366954 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dc5e34e-4f42-4e16-a1e0-b723470b0a7c req-981197e9-1690-4f7b-ac27-cf6281c5ac26 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340784 Sep 03 11:32:43.666043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 899e44c5-355a-4338-a2c9-3e4bfe86e3be up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:32:43.736869 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:43.765530 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 899e44c5-355a-4338-a2c9-3e4bfe86e3be completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:32:43.769506 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 899e44c5-355a-4338-a2c9-3e4bfe86e3be triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:32:43.769877 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:43.795888 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeeb5b58-6c59-419b-a21a-4583eb6e0d9a req-0c031a63-4fce-412c-8f60-5ffd0e4c802d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:43.797670 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-aeeb5b58-6c59-419b-a21a-4583eb6e0d9a req-0c031a63-4fce-412c-8f60-5ffd0e4c802d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 945 time: 0.0506833 Sep 03 11:32:43.836441 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-aeeb5b58-6c59-419b-a21a-4583eb6e0d9a req-5781948a-1f11-4c5c-b724-16fb7a8574bf tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323539 Sep 03 11:32:43.850107 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:43.873299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:43.875583 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d33f51e2-ca56-42cb-95d3-476c5ca50853" -d '{"events": [{"server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "name": "network-vif-plugged", "status": "completed", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:43.891259 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:43.912063 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c46c94fa-08cb-47c4-b991-98c0c35eeff0 x-openstack-request-id: req-c46c94fa-08cb-47c4-b991-98c0c35eeff0 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:43.912371 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "name": "network-vif-plugged", "status": "completed", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:43.912604 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c46c94fa-08cb-47c4-b991-98c0c35eeff0 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:43.912985 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be', 'code': 200} Sep 03 11:32:43.937082 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:43.987117 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:44.183697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d5c676-52a1-46d6-a902-6837fad791ea req-15a88dd7-3229-4239-9b89-5fe903bb58f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:44.185249 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-31d5c676-52a1-46d6-a902-6837fad791ea req-15a88dd7-3229-4239-9b89-5fe903bb58f6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 1099 time: 0.0394101 Sep 03 11:32:44.223340 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-31d5c676-52a1-46d6-a902-6837fad791ea req-c8f55768-a880-4db9-8062-3ff41da3ac78 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0292437 Sep 03 11:32:44.486473 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78969c02-19f4-4cdc-ac05-1f6fe2d5c68c req-7d309a64-b9b1-44df-9ad2-0d132e38258d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:44.487922 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78969c02-19f4-4cdc-ac05-1f6fe2d5c68c req-7d309a64-b9b1-44df-9ad2-0d132e38258d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0526638 Sep 03 11:32:44.525633 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78969c02-19f4-4cdc-ac05-1f6fe2d5c68c req-b513d842-7359-412c-823f-1b8b56480f72 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317039 Sep 03 11:32:44.642253 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ce4832c-7361-4dad-970e-cb09a9407672 req-bfa841e1-9ce5-4fa1-8722-6f587cadf64c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:44.644903 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ce4832c-7361-4dad-970e-cb09a9407672 req-bfa841e1-9ce5-4fa1-8722-6f587cadf64c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0510983 Sep 03 11:32:44.681598 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ce4832c-7361-4dad-970e-cb09a9407672 req-82e19ac4-8306-4b32-af5b-d6be570e514d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319538 Sep 03 11:32:44.949492 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58504e2c-c0ee-46e4-9ff6-4984ac972083 req-b4ac7d0f-5143-4a7e-a2ee-113708a50edb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:44.950891 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-58504e2c-c0ee-46e4-9ff6-4984ac972083 req-b4ac7d0f-5143-4a7e-a2ee-113708a50edb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 946 time: 0.0487466 Sep 03 11:32:44.988592 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-58504e2c-c0ee-46e4-9ff6-4984ac972083 req-ed504815-50dd-4c1f-b03f-b6b568663f89 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317924 Sep 03 11:32:46.100900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddaf14c9-486d-48ef-a9c7-596b7762a3af req-38a0fe26-f410-46db-b06e-708c7e3ca5b3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:46.102405 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ddaf14c9-486d-48ef-a9c7-596b7762a3af req-38a0fe26-f410-46db-b06e-708c7e3ca5b3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 946 time: 0.0481074 Sep 03 11:32:46.140110 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ddaf14c9-486d-48ef-a9c7-596b7762a3af req-5fb26f75-47f3-4335-9bdd-9c114eed1df9 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313146 Sep 03 11:32:46.839042 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc98a57-033d-4f5d-996e-3b5ff9b94570 req-b2211f63-795e-4c92-b9b2-39de2e3a1a1c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:46.840415 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1cc98a57-033d-4f5d-996e-3b5ff9b94570 req-b2211f63-795e-4c92-b9b2-39de2e3a1a1c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0548582 Sep 03 11:32:46.858002 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-fed48222-d273-475d-ad5a-29937b696b31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:46.859622 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-fed48222-d273-475d-ad5a-29937b696b31 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0417783 Sep 03 11:32:46.879410 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1cc98a57-033d-4f5d-996e-3b5ff9b94570 req-e8bdbff9-12da-47f4-97d1-c5ec4c7d2dcb tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328033 Sep 03 11:32:46.958196 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-ab838a54-847d-4f8a-b516-604b10831371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:46.959727 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-ab838a54-847d-4f8a-b516-604b10831371 service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.0924201 Sep 03 11:32:47.014127 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-e5a910e6-a822-427b-8fcf-651903d11abf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 217 time: 0.0359135 Sep 03 11:32:47.073359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-d0770a67-dd4c-4739-949b-b75c8335103b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:47.074842 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-d0770a67-dd4c-4739-949b-b75c8335103b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0499494 Sep 03 11:32:47.107320 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-0ecd0342-68dd-4d0a-896d-684bd05fa624 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236104 Sep 03 11:32:47.197474 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-31f9e340-b1d3-4760-ac4d-e129b66d1149 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813437 Sep 03 11:32:47.301930 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6ac6b04-5275-4399-88a7-3222462b0d77 req-690b883d-9de5-44b7-8c6c-ab449f6a7c5c service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875251 Sep 03 11:32:47.468563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928143bb-c376-4262-bceb-150ce87e31eb req-d4a600b6-dbe5-4f33-aa0d-2b7683b7271a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:47.468563 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-928143bb-c376-4262-bceb-150ce87e31eb req-d4a600b6-dbe5-4f33-aa0d-2b7683b7271a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 946 time: 0.0499010 Sep 03 11:32:47.505469 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-928143bb-c376-4262-bceb-150ce87e31eb req-ea0fe3c9-f70d-4175-8352-2d597fc61a61 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331535 Sep 03 11:32:47.997333 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd81b16-c1bc-47ec-98a1-00f7014e3f9e req-4af6e810-8910-4a9d-9673-b7c3151ad2c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:47.998819 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5fd81b16-c1bc-47ec-98a1-00f7014e3f9e req-4af6e810-8910-4a9d-9673-b7c3151ad2c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0475237 Sep 03 11:32:48.039750 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5fd81b16-c1bc-47ec-98a1-00f7014e3f9e req-7209279a-545e-492c-b1b1-812fadb20b10 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348930 Sep 03 11:32:48.623463 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab35b0c2-7982-41a6-a7e1-93b5658424d4 req-5f809d44-0752-4e07-8a1c-ff377c999d84 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:48.624915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ab35b0c2-7982-41a6-a7e1-93b5658424d4 req-5f809d44-0752-4e07-8a1c-ff377c999d84 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 946 time: 0.0542097 Sep 03 11:32:48.881566 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ab35b0c2-7982-41a6-a7e1-93b5658424d4 req-8a2b742d-40ba-4921-a9fd-6ed4f0dd6eaf tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2506928 Sep 03 11:32:49.155013 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8324ea9-4ef5-47f3-97af-d43952197698 req-f221ec73-7c0c-46b4-af7b-c4a4e9e0603c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:49.156493 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c8324ea9-4ef5-47f3-97af-d43952197698 req-f221ec73-7c0c-46b4-af7b-c4a4e9e0603c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0496480 Sep 03 11:32:49.194987 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c8324ea9-4ef5-47f3-97af-d43952197698 req-39144be6-2436-4e79-8a1e-fe926487e510 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324047 Sep 03 11:32:49.399628 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-32495690-eb02-4e1c-90e9-3f01b1459c18 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:49.401100 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-32495690-eb02-4e1c-90e9-3f01b1459c18 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 946 time: 0.0487995 Sep 03 11:32:49.498369 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Deleting port 899e44c5-355a-4338-a2c9-3e4bfe86e3be {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:32:49.498731 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:49.586606 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] For port 899e44c5-355a-4338-a2c9-3e4bfe86e3be, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=899e44c5-355a-4338-a2c9-3e4bfe86e3be,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:49.586971 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:49.599860 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Calling delete_port for 899e44c5-355a-4338-a2c9-3e4bfe86e3be owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:32:49.793999 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:49.808993 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['899e44c5-355a-4338-a2c9-3e4bfe86e3be'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:32:49.831406 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Pushing event deleted for resources: {'Port': ['ID=899e44c5-355a-4338-a2c9-3e4bfe86e3be,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:49.869805 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] No DVR routers for this DVR port 899e44c5-355a-4338-a2c9-3e4bfe86e3be on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:32:49.872974 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:49.875090 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f6695330-d760-4baa-8a7c-5b8ffeaf71aa req-f58af1bd-4965-44a3-bee5-0976865a9991 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "DELETE /v2.0/ports/899e44c5-355a-4338-a2c9-3e4bfe86e3be HTTP/1.1" status: 204 len: 173 time: 0.4661081 Sep 03 11:32:49.875548 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'name': 'network-vif-deleted', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:49.877922 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3113b44d-841a-4ce6-a9d0-0d4efd4e23f9" -d '{"events": [{"server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "name": "network-vif-deleted", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:49.920172 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c93045b-5dd8-4169-974a-ffaf945d81cc x-openstack-request-id: req-2c93045b-5dd8-4169-974a-ffaf945d81cc {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:49.921333 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "26d6f762-97ce-478b-9b3f-3982d5b89776", "name": "network-vif-deleted", "tag": "899e44c5-355a-4338-a2c9-3e4bfe86e3be", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:49.921593 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2c93045b-5dd8-4169-974a-ffaf945d81cc {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:49.921993 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '26d6f762-97ce-478b-9b3f-3982d5b89776', 'name': 'network-vif-deleted', 'tag': '899e44c5-355a-4338-a2c9-3e4bfe86e3be', 'status': 'completed', 'code': 200} Sep 03 11:32:49.986738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-91f0524a-4179-4240-9668-468c5c49b339 req-02b4a1b1-534f-47cd-9dfc-fb5b8215fdb6 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=26d6f762-97ce-478b-9b3f-3982d5b89776 HTTP/1.1" status: 200 len: 210 time: 0.0264118 Sep 03 11:32:50.320852 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bee10f5-8e0e-4953-8bd9-0c49b5ff5b29 req-75f1e147-7c2f-4305-803b-a70a8257bb0e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:50.323017 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1bee10f5-8e0e-4953-8bd9-0c49b5ff5b29 req-75f1e147-7c2f-4305-803b-a70a8257bb0e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0519636 Sep 03 11:32:50.362251 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1bee10f5-8e0e-4953-8bd9-0c49b5ff5b29 req-b3a8b469-04f4-4e15-bb3f-74dfeab6d2e0 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330303 Sep 03 11:32:51.236526 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-43900fd1-138f-44ea-8055-51d7124cb9b8 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:51.237980 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-43900fd1-138f-44ea-8055-51d7124cb9b8 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/networks?id=82386b1b-1e2a-418d-8be9-a666ddcb7220 HTTP/1.1" status: 200 len: 808 time: 0.0980628 Sep 03 11:32:51.252747 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-a02e6d7d-285b-4d1b-bbeb-8e271dce699c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/quotas/b669eeee0b744c35aee3612d15269920 HTTP/1.1" status: 200 len: 375 time: 0.0091708 Sep 03 11:32:51.286312 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-dfa9c838-d22f-4a44-95bb-73957e28a453 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0285664 Sep 03 11:32:51.377645 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-9a07bbd5-9634-438b-b9db-c149c9da701e service neutron] 10.222.0.16 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842741 Sep 03 11:32:51.503738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-a0fb7e3e-0390-42c2-9bd6-f80041e3effe service neutron] 10.222.0.16 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1202424 Sep 03 11:32:51.512593 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7906c2e0-c82e-49d0-8c3c-e35ae399a9ee req-9d3dd03d-a0b5-4cfc-bada-27e3bff875c4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:51.514014 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7906c2e0-c82e-49d0-8c3c-e35ae399a9ee req-9d3dd03d-a0b5-4cfc-bada-27e3bff875c4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0683897 Sep 03 11:32:51.555959 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7906c2e0-c82e-49d0-8c3c-e35ae399a9ee req-c61cf0fa-999e-4047-aa2c-bf199d43d8be tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358214 Sep 03 11:32:51.788430 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-faa467a5-5932-4c0a-8688-dabe61224551 req-67b64953-a399-4c39-aad5-ab62420a4f23 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 210 time: 0.0266263 Sep 03 11:32:52.672351 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70799883-a567-4107-857f-e9bd4a1500d3 req-0e2b4a94-9428-43ad-a605-318a2e8c5549 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:52.673808 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-70799883-a567-4107-857f-e9bd4a1500d3 req-0e2b4a94-9428-43ad-a605-318a2e8c5549 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0506632 Sep 03 11:32:52.712067 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-70799883-a567-4107-857f-e9bd4a1500d3 req-aa3d1135-f0ff-430a-85e6-608b0eb3008e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324249 Sep 03 11:32:52.878533 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-94cd3c79-1bde-44bb-b343-ab6a2589852c req-0a0ca4c7-ecb7-4312-970f-3864474e2f26 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 210 time: 0.0264978 Sep 03 11:32:53.593847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-8fe53925-ee3d-40fc-93e0-6c3ae8e5a008 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:53.595347 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-8fe53925-ee3d-40fc-93e0-6c3ae8e5a008 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "GET /v2.0/networks?id=82386b1b-1e2a-418d-8be9-a666ddcb7220 HTTP/1.1" status: 200 len: 808 time: 0.1003814 Sep 03 11:32:53.609719 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Request body: {'port': {'device_id': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220', 'admin_state_up': True, 'tenant_id': 'b669eeee0b744c35aee3612d15269920'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:53.662840 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-339c25da-b799-4a69-a0be-529ca93ccf9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:53.687514 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 899e44c5-355a-4338-a2c9-3e4bfe86e3be no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:32:53.707543 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 899e44c5-355a-4338-a2c9-3e4bfe86e3be {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:32:53.707884 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 899e44c5-355a-4338-a2c9-3e4bfe86e3be not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:32:53.771232 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Made reservation on behalf of b669eeee0b744c35aee3612d15269920 for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:32:53.775043 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:53.825771 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19492ce-8f2b-4e13-91ca-69bb369ce3e1 req-05dfc117-0fb4-4664-91ab-94fe54604acd tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:53.827368 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b19492ce-8f2b-4e13-91ca-69bb369ce3e1 req-05dfc117-0fb4-4664-91ab-94fe54604acd tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0481641 Sep 03 11:32:53.867107 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b19492ce-8f2b-4e13-91ca-69bb369ce3e1 req-2256c5fa-295f-44d4-9af0-f5c49f663d2d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334036 Sep 03 11:32:53.902063 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Allocated IP 172.20.0.11 (82386b1b-1e2a-418d-8be9-a666ddcb7220/44fde28d-267c-4bed-b76b-3cabf5dda5a8/a8d91691-2be6-4f9b-8c69-fcf5c734aaf4) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:32:53.980806 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1e6c457a-b046-45b7-9439-50553bec9b99 req-a4588a86-ba70-4998-8103-a4c58062403c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 210 time: 0.0269792 Sep 03 11:32:54.060451 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.171221 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.214514 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Network 82386b1b-1e2a-418d-8be9-a666ddcb7220 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:32:54.217521 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:54.221217 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:32:54.249677 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Pushing event updated for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:54.277132 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:54.277739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.348600 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-956c3bcf-8bcb-4507-a8f7-3a81572f334d tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7427025 Sep 03 11:32:54.370815 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Request body: {'port': {'device_id': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:54.423815 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.684259 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:54.691718 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.703316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Transition to ACTIVE for port object a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:32:54.787808 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.852680 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Pushing event updated for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:54.904189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Attempting to bind port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:32:54.904506 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Attempting to bind port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:32:54.904894 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Attempting to bind port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:54.909296 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:32:54.909615 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Attempting to bind port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 on network 82386b1b-1e2a-418d-8be9-a666ddcb7220 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:32:54.914476 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 32, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:32:54.914814 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Checking segment: {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:32:54.915187 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Bound using segment: {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:32:54.915605 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Bound port: a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06ffc106-b4b7-4f79-867c-120424c01651', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:32:54.916067 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:54.983595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:32:54.984490 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53aa510-7ee6-459a-8a2c-8f5febdc4efe req-40a8899e-4a7f-4951-8204-b79b5a3da2d6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:54.985996 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b53aa510-7ee6-459a-8a2c-8f5febdc4efe req-40a8899e-4a7f-4951-8204-b79b5a3da2d6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0510221 Sep 03 11:32:54.986593 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:32:55.023482 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b53aa510-7ee6-459a-8a2c-8f5febdc4efe req-f485652e-92af-4815-bf98-f35e28f334c8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314720 Sep 03 11:32:55.097135 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea73fe3-5b2f-4ef4-ae5f-141e8d78499f req-b8e54aa4-00a6-4092-98d9-4cb593ea98eb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.098680 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bea73fe3-5b2f-4ef4-ae5f-141e8d78499f req-b8e54aa4-00a6-4092-98d9-4cb593ea98eb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 944 time: 0.0489728 Sep 03 11:32:55.103001 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:55.139497 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.140121 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:55.141030 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bea73fe3-5b2f-4ef4-ae5f-141e8d78499f req-1a41234f-a84a-43ff-b238-6b2dd473792c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362566 Sep 03 11:32:55.141594 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] 10.222.0.11 "PUT /v2.0/ports/a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 HTTP/1.1" status: 200 len: 1094 time: 0.7753928 Sep 03 11:32:55.142036 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:32:55.144315 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77220f08-5470-4864-9764-e60715eb11db" -d '{"events": [{"name": "network-changed", "server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:32:55.168938 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7175475d-58dc-4127-abcb-713c43fc12ce service neutron] Pushing event updated for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:55.185052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:32:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f36f21f-9f56-42af-85df-8d040f4c6cb8 x-openstack-request-id: req-2f36f21f-9f56-42af-85df-8d040f4c6cb8 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:32:55.185361 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:32:55.185601 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2f36f21f-9f56-42af-85df-8d040f4c6cb8 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:32:55.185989 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4', 'status': 'completed', 'code': 200} Sep 03 11:32:55.254692 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77220f08-5470-4864-9764-e60715eb11db req-3950bd30-5932-44cf-988c-40c5d7a76919 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.256089 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-77220f08-5470-4864-9764-e60715eb11db req-3950bd30-5932-44cf-988c-40c5d7a76919 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 1097 time: 0.0405586 Sep 03 11:32:55.361909 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77220f08-5470-4864-9764-e60715eb11db req-7aebc6e3-b123-4df4-a211-301e7bcdb6eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.363432 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-77220f08-5470-4864-9764-e60715eb11db req-7aebc6e3-b123-4df4-a211-301e7bcdb6eb service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=b669eeee0b744c35aee3612d15269920&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0980139 Sep 03 11:32:55.462527 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77220f08-5470-4864-9764-e60715eb11db req-4e186934-58ee-426e-b30f-ce9a558daeb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.464619 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-77220f08-5470-4864-9764-e60715eb11db req-4e186934-58ee-426e-b30f-ce9a558daeb5 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0877204 Sep 03 11:32:55.550241 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-ea0adc48-7f98-48eb-8313-eb3f5c14f8a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.551749 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-ea0adc48-7f98-48eb-8313-eb3f5c14f8a5 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b669eeee0b744c35aee3612d15269920&device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 1097 time: 0.0395639 Sep 03 11:32:55.598204 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-76389554-a21f-4109-bf50-3eea4dd7702e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 HTTP/1.1" status: 200 len: 217 time: 0.0361674 Sep 03 11:32:55.648179 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-a4d8555e-b2d1-4cb2-b90c-541ee87a6929 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:55.649571 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-a4d8555e-b2d1-4cb2-b90c-541ee87a6929 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=44fde28d-267c-4bed-b76b-3cabf5dda5a8 HTTP/1.1" status: 200 len: 848 time: 0.0424433 Sep 03 11:32:55.680344 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-9523f5a0-b30c-4451-aabb-d2f14f1bb2e9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=82386b1b-1e2a-418d-8be9-a666ddcb7220&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0224321 Sep 03 11:32:55.776565 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-d2f08b09-d58c-485a-8c6d-5f026d04f087 service neutron] 10.222.0.11 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871713 Sep 03 11:32:55.877717 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d667b688-e4ec-4353-90ab-67477dbe6ee8 req-3029af7e-e0b8-4c45-bc13-fa8ce8836ea3 service neutron] 10.222.0.11 "GET /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822718 Sep 03 11:32:56.143211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f9d6c2-a35f-484c-9fae-5ec0a820e1b4 req-c3f2edcd-e317-4b1f-8438-3999cade3aab tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:56.144686 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-14f9d6c2-a35f-484c-9fae-5ec0a820e1b4 req-c3f2edcd-e317-4b1f-8438-3999cade3aab tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0490751 Sep 03 11:32:56.185559 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-14f9d6c2-a35f-484c-9fae-5ec0a820e1b4 req-045dd125-c50b-4c3d-ab62-bddf1fdc4ff8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349615 Sep 03 11:32:56.264981 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a21811-9aee-41da-a964-e9d1fea387aa req-4cfeadb7-0ece-435d-b30c-36f9fcb8a1d7 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:56.266592 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-74a21811-9aee-41da-a964-e9d1fea387aa req-4cfeadb7-0ece-435d-b30c-36f9fcb8a1d7 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 944 time: 0.0557096 Sep 03 11:32:56.297037 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5463b170-af25-45f9-9d4f-fc92cf0153e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:56.309411 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-74a21811-9aee-41da-a964-e9d1fea387aa req-38f6e59c-440f-4cbe-93d7-508be594027b tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367579 Sep 03 11:32:56.685105 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:56.950685 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:32:57.315909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0c0d68-eea8-475c-aebd-deac5032e256 req-5ca6e9d8-a02b-411e-83e8-7ab256767114 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:57.317683 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f0c0d68-eea8-475c-aebd-deac5032e256 req-5ca6e9d8-a02b-411e-83e8-7ab256767114 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0571315 Sep 03 11:32:57.364034 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f0c0d68-eea8-475c-aebd-deac5032e256 req-97672246-34c1-4568-be45-833e4e08e25f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367284 Sep 03 11:32:57.425819 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80f1d5a-aa39-4ea3-905f-e5744cf2443a req-58fba343-def8-41ad-a76e-957dc80889d5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:57.427373 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c80f1d5a-aa39-4ea3-905f-e5744cf2443a req-58fba343-def8-41ad-a76e-957dc80889d5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 944 time: 0.0497308 Sep 03 11:32:57.479019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c80f1d5a-aa39-4ea3-905f-e5744cf2443a req-cfaf0102-07ab-4889-b748-e291b0b68098 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457411 Sep 03 11:32:57.513982 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a0e8e8b-a0c9-442d-b13b-d66eef26d16f req-a318298f-21a0-4138-81c9-61c67a19b3e1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:57.515480 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8a0e8e8b-a0c9-442d-b13b-d66eef26d16f req-a318298f-21a0-4138-81c9-61c67a19b3e1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0564513 Sep 03 11:32:57.552767 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8a0e8e8b-a0c9-442d-b13b-d66eef26d16f req-0a2ce252-2a49-41e3-b568-b76c27dee8bd tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312469 Sep 03 11:32:57.576177 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35840) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:57.634271 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:57.713956 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00c11fe9-53ed-4480-98b7-6d31a824e832 tempest-TestMinimumBasicScenario-821129196 tempest-TestMinimumBasicScenario-821129196-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:57.716099 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-00c11fe9-53ed-4480-98b7-6d31a824e832 tempest-TestMinimumBasicScenario-821129196 tempest-TestMinimumBasicScenario-821129196-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1094 time: 0.1389368 Sep 03 11:32:57.718922 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35850) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:32:57.723229 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'port_id': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'fixed_ip_address': '172.20.0.12'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:32:57.805380 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for floatingip, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:57.909017 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:58.009950 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Allocated IP 172.27.0.65 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/35676349-856e-44ec-bc48-2b37e9ac1640) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:32:58.111141 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:58.205450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:58.242613 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:32:58.245420 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:32:58.249648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:32:58.272840 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'Port': ['ID=35676349-856e-44ec-bc48-2b37e9ac1640,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:58.512048 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f7b4ba-5965-415e-8e44-23378054c6c6 req-9e2ce376-3749-430d-b34f-923ca2bee40d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:58.513447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d1f7b4ba-5965-415e-8e44-23378054c6c6 req-9e2ce376-3749-430d-b34f-923ca2bee40d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0749567 Sep 03 11:32:58.653088 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d1f7b4ba-5965-415e-8e44-23378054c6c6 req-fdecc510-6fb4-45ce-a832-00d83f995544 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1332850 Sep 03 11:32:58.705542 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36740b8-605c-400c-98c1-907346de5843 req-78abcafa-b34c-422b-b4c5-031bb0690d5a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:58.712889 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e36740b8-605c-400c-98c1-907346de5843 req-78abcafa-b34c-422b-b4c5-031bb0690d5a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 944 time: 0.1577704 Sep 03 11:32:58.758209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:58.794962 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e36740b8-605c-400c-98c1-907346de5843 req-18a14f39-1e47-4b98-8056-80ec9d37cc73 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733397 Sep 03 11:32:58.920231 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.049794 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.070503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.149602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.229084 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'Port': ['ID=35676349-856e-44ec-bc48-2b37e9ac1640,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:32:59.240767 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:32:59.266487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.348224 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Floating IP d04e2da6-37d3-468d-85ee-16828e6c6a21 associated. External IP: 172.27.0.65, port: 0c1a0140-6eb6-4bae-ba93-b742e42fed8e. Sep 03 11:32:59.564083 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:32:59.667843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:32:59.681800 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Sync routers for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:32:59.692213 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:32:59.692896 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:32:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:32:59.720760 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:32:59.771796 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842aceb2-74d7-4d85-8750-fccd4888605a req-a54705ab-b874-4d98-837a-cc85d774b02f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:59.773840 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-842aceb2-74d7-4d85-8750-fccd4888605a req-a54705ab-b874-4d98-837a-cc85d774b02f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0504203 Sep 03 11:32:59.809368 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:32:59.818558 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:59.825388 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-842aceb2-74d7-4d85-8750-fccd4888605a req-fd837ea4-08af-4b32-b966-8caab5407ac6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438251 Sep 03 11:32:59.831101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4', 'network_id': '82386b1b-1e2a-418d-8be9-a666ddcb7220', 'port_id': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4', 'mac_address': 'fa:16:3e:9b:d1:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 364, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '44fde28d-267c-4bed-b76b-3cabf5dda5a8', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:32:59.871399 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:32:59.887960 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:32:59.908230 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:32:59.949890 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f4666b-7ac0-4199-8fa6-778043f0113e req-2e997507-d552-4ee3-a81d-2153327cc4a5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:32:59.951525 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3f4666b-7ac0-4199-8fa6-778043f0113e req-2e997507-d552-4ee3-a81d-2153327cc4a5 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 944 time: 0.0501347 Sep 03 11:32:59.954103 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.004683 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a698c9a3-b72e-4ffe-a688-16aac346b83e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2820654 Sep 03 11:33:00.004683 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:00.005005 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35868) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:00.005729 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc" -d '{"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:00.007530 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.009561 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-404849827', 'description': 'tempest-secgroup-smoke-404849827 description', 'project_id': 'a929f96c596b45e78449a64936959efe'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:00.075990 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'd04e2da6-37d3-468d-85ee-16828e6c6a21', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'floating_ip_address': '172.27.0.65', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'port_id': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'mac_address': 'fa:16:3e:80:56:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496f48b8-0710-41da-907b-a7938371e02d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:32:58Z', 'updated_at': '2021-09-03T11:32:58Z', 'revision_number': 0, 'project_id': 'a929f96c596b45e78449a64936959efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:00.079968 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:00.104621 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Checking router: 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:33:00.114362 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:33:00.115005 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:32:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:00.120006 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.226198 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.278328 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3f4666b-7ac0-4199-8fa6-778043f0113e req-7a67f61f-8def-4c7c-ae6e-14abb398c7f9 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3045886 Sep 03 11:33:00.299969 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e982c3d4-6aeb-4089-a1c7-620ea461ba42 req-1d67793a-4f49-4385-926a-166bff7f723d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.302080 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e982c3d4-6aeb-4089-a1c7-620ea461ba42 req-1d67793a-4f49-4385-926a-166bff7f723d tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.2883446 Sep 03 11:33:00.318754 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:33:00.320138 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.326865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52765c48-9af6-468c-afb6-2327269dde9d x-openstack-request-id: req-52765c48-9af6-468c-afb6-2327269dde9d {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:00.327059 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:00.327401 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-52765c48-9af6-468c-afb6-2327269dde9d {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:00.327855 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:33:00.356475 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e982c3d4-6aeb-4089-a1c7-620ea461ba42 req-2f2ac72f-5ed2-4f46-a286-e88046eff929 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487630 Sep 03 11:33:00.365839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:00.395985 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.399319 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.400111 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.400111 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:33:00.403360 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['a8d91691-2be6-4f9b-8c69-fcf5c734aaf4'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:00.417842 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.422140 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f324914e-760b-420f-bf1f-abeb8295bae7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.4133406 Sep 03 11:33:00.422140 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-924ff8c2-c6be-4763-9ab7-936193f2e102 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.422583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35872) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:00.427522 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-924ff8c2-c6be-4763-9ab7-936193f2e102 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1099 time: 0.0584769 Sep 03 11:33:00.427713 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:00.533910 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.534540 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-9ab72668-742d-4737-af9a-cc5b5a448f27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.536282 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-9ab72668-742d-4737-af9a-cc5b5a448f27 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.0950332 Sep 03 11:33:00.563985 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'd04e2da6-37d3-468d-85ee-16828e6c6a21', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'floating_ip_address': '172.27.0.65', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'port_id': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'mac_address': 'fa:16:3e:80:56:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496f48b8-0710-41da-907b-a7938371e02d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:32:58Z', 'updated_at': '2021-09-03T11:32:58Z', 'revision_number': 0, 'project_id': 'a929f96c596b45e78449a64936959efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:00.583171 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.594996 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f347fdb-a502-4dcf-ac29-a408cdcf0d54 None None] The sync data for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi is: [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'd04e2da6-37d3-468d-85ee-16828e6c6a21', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'floating_ip_address': '172.27.0.65', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'port_id': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 404, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'mac_address': 'fa:16:3e:80:56:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496f48b8-0710-41da-907b-a7938371e02d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:32:58Z', 'updated_at': '2021-09-03T11:32:58Z', 'revision_number': 0, 'project_id': 'a929f96c596b45e78449a64936959efe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:33:00.605197 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-ceaee230-0e25-4747-9401-b1d63e3604ff service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 999 time: 0.0587218 Sep 03 11:33:00.651092 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.663193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-5d12e3e5-6162-4538-88e5-14dbaca8bac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.664929 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-5d12e3e5-6162-4538-88e5-14dbaca8bac3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0474701 Sep 03 11:33:00.669713 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc7a4758-8e2f-4f6e-a8c0-e12bd6f6aa51,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:00.720668 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-3b12f237-6282-46c0-9854-34917379bbeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.722189 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-3b12f237-6282-46c0-9854-34917379bbeb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0456262 Sep 03 11:33:00.771201 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.773516 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a42f783d-66d3-41c1-b232-872cf2ad06b9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3487310 Sep 03 11:33:00.775156 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35876) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:00.780565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:00.791568 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e007e377-6eb5-4897-ab75-ee8602b5a811 None None] New status for floating IP d04e2da6-37d3-468d-85ee-16828e6c6a21: ACTIVE {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:33:00.827872 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-841fe2af-0ff6-4315-ab76-34cbf5b46b0d service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918236 Sep 03 11:33:00.862733 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.939152 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-426c19a9-b8c9-4273-a5ec-de1858d0b1cc req-8e6c2a6a-a879-49a1-810e-29111abd1a6c service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1022284 Sep 03 11:33:00.975874 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:00.987640 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d6b152-aa4a-48f8-adbb-bd938c810366 req-6834b020-7c08-4100-9cb6-8320eb548971 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:00.989139 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-21d6b152-aa4a-48f8-adbb-bd938c810366 req-6834b020-7c08-4100-9cb6-8320eb548971 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0802417 Sep 03 11:33:01.031462 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-21d6b152-aa4a-48f8-adbb-bd938c810366 req-a5800752-9b55-405e-8430-7feb3c0a026b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340722 Sep 03 11:33:01.062125 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.080480 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e908f1c3-eca8-45a3-8030-4706bd6344b8,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:01.136666 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.137758 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1c5b1978-7804-4c35-8c28-18106b3fa28d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3615782 Sep 03 11:33:01.140427 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 35880) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:01.144834 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:01.221509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.277575 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.342756 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.383874 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b771d831-ab1a-4296-b363-938db3db4872,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:01.408437 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff40eec-4e4c-4f99-9afe-7fa894998a23 req-2db00baa-626f-4600-bee7-803906b88d3c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:01.409978 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4ff40eec-4e4c-4f99-9afe-7fa894998a23 req-2db00baa-626f-4600-bee7-803906b88d3c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 945 time: 0.0627887 Sep 03 11:33:01.446052 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.447183 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-54829081-3a2e-41b1-b7d4-2d0e8199d679 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3058050 Sep 03 11:33:01.450170 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35886) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:01.454955 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:01.481343 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4ff40eec-4e4c-4f99-9afe-7fa894998a23 req-53c65e40-7f23-474c-9b24-94d65c8cf6b7 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654132 Sep 03 11:33:01.498197 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ce42a3-c774-47bc-836d-bb21b8d4c929 req-337ff2bc-2608-47b5-b3f7-ebf5a3c75b0a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:01.502397 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-86ce42a3-c774-47bc-836d-bb21b8d4c929 req-337ff2bc-2608-47b5-b3f7-ebf5a3c75b0a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.0671928 Sep 03 11:33:01.537627 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-86ce42a3-c774-47bc-836d-bb21b8d4c929 req-22fec586-b397-442f-97cb-7fe0014aa3e5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318120 Sep 03 11:33:01.545844 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.601595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.666893 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.685829 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c2a9d9b-4ec1-440f-85fa-2177f409cba8,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:01.733547 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:33:01.759636 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.760858 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-292a4159-a981-4c61-8c9b-3d3736e15086 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3096576 Sep 03 11:33:01.763577 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35888) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:01.767971 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:01.862440 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:33:01.867247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:33:01.867675 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.879587 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Project a929f96c596b45e78449a64936959efe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:33:01.884833 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.945914 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.958050 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:01.974055 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:01.976367 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2035d3d3-7bfd-4bee-8732-a8f478e623e6" -d '{"events": [{"server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "name": "network-vif-plugged", "status": "completed", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:01.988931 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:02.013694 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55a8283d-68e8-4f5d-a246-845b7aac8c07 x-openstack-request-id: req-55a8283d-68e8-4f5d-a246-845b7aac8c07 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:02.013979 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "name": "network-vif-plugged", "status": "completed", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:02.014225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-55a8283d-68e8-4f5d-a246-845b7aac8c07 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:02.014640 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4', 'code': 200} Sep 03 11:33:02.074684 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.114047 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.126040 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03b39fa6-0fcd-4f78-a67f-7db55cef1cdc,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:02.149483 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-9b67a67d-4af3-45f0-98a9-2d323f686637 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.152679 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-9b67a67d-4af3-45f0-98a9-2d323f686637 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 946 time: 0.0704746 Sep 03 11:33:02.168968 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c2caca-12ed-4a8d-a15f-a894d19d9ee3 req-82784372-18cd-4a44-a8ea-f49078ed6f3d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.170567 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79c2caca-12ed-4a8d-a15f-a894d19d9ee3 req-82784372-18cd-4a44-a8ea-f49078ed6f3d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0706570 Sep 03 11:33:02.184335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:02.200367 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.202036 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-56088df6-1258-48a6-9fad-f25757707b46 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4370170 Sep 03 11:33:02.205115 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 35894) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:02.216050 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'security_group_rule': {'security_group_id': '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf', 'project_id': 'a929f96c596b45e78449a64936959efe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:02.219857 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79c2caca-12ed-4a8d-a15f-a894d19d9ee3 req-a28f1881-44ff-4114-a92b-f432a105d995 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414772 Sep 03 11:33:02.284335 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Deleting port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:33:02.284675 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.345745 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Project a929f96c596b45e78449a64936959efe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:33:02.358015 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.372385 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d616ee-cffe-4dcf-8248-0150e936b2f6 req-27aa9646-db2a-4838-a6bc-c39136d7adab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.373875 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b2d616ee-cffe-4dcf-8248-0150e936b2f6 req-27aa9646-db2a-4838-a6bc-c39136d7adab service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 1099 time: 0.0397403 Sep 03 11:33:02.400771 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] For port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:02.401132 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.414751 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b2d616ee-cffe-4dcf-8248-0150e936b2f6 req-cbe98709-5e77-4196-8eff-c5f10bea51de service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309410 Sep 03 11:33:02.425002 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Calling delete_port for 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:33:02.445571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.508283 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.553249 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=427e4b65-9233-40ea-9388-c34c483ea0d3,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:02.598791 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b64614-8b05-4507-ae21-93a2c239bf62 req-bea7aba3-62e5-4610-9b19-ca78ce91c5a1 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.600289 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-38b64614-8b05-4507-ae21-93a2c239bf62 req-bea7aba3-62e5-4610-9b19-ca78ce91c5a1 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0506396 Sep 03 11:33:02.657070 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.658326 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-19e0c220-8bcc-44f2-9b0d-036c5e4bdca1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4521627 Sep 03 11:33:02.665952 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-38b64614-8b05-4507-ae21-93a2c239bf62 req-855e40c4-f142-47a0-b6a2-0a5db2bea3ac tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584095 Sep 03 11:33:02.668626 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.686114 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d9810d-f051-4e25-b57e-43ea9acd1252 req-bde9089a-14e5-4d7f-a9df-ae10f850efa2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.686114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34d9810d-f051-4e25-b57e-43ea9acd1252 req-bde9089a-14e5-4d7f-a9df-ae10f850efa2 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 867 time: 0.0744517 Sep 03 11:33:02.689619 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8', 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', '221c6012-4b26-4d7d-b7e8-145356803449', '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:02.701389 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event deleted for resources: {'Port': ['ID=3f1d41ae-f270-4229-8991-c6a9aa7b7b6c,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:02.728340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34d9810d-f051-4e25-b57e-43ea9acd1252 req-133c8a43-339b-4717-a82a-df11230b73ec tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420291 Sep 03 11:33:02.757302 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] No DVR routers for this DVR port 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:33:02.760729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:02.763631 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8c8bf92a-669e-40a0-bacf-99f19858ea6e req-8a6364fe-756b-4bf8-a193-4b45e0831d32 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "DELETE /v2.0/ports/3f1d41ae-f270-4229-8991-c6a9aa7b7b6c HTTP/1.1" status: 204 len: 173 time: 0.6000793 Sep 03 11:33:02.763937 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'name': 'network-vif-deleted', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:02.767393 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4018001e-ad89-4458-8782-650026d7ff7b" -d '{"events": [{"server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "name": "network-vif-deleted", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:02.789327 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-5d3d17f3-47ea-4e07-bf50-41a225eefd21 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-404849827&fields=id&tenant_id=a929f96c596b45e78449a64936959efe HTTP/1.1" status: 200 len: 267 time: 0.0518262 Sep 03 11:33:02.805883 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db278c63-5d16-48d4-92d1-33692640e210 x-openstack-request-id: req-db278c63-5d16-48d4-92d1-33692640e210 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:02.806171 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f439798-36cf-4159-98d8-7530412a9647", "name": "network-vif-deleted", "tag": "3f1d41ae-f270-4229-8991-c6a9aa7b7b6c", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:02.806443 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-db278c63-5d16-48d4-92d1-33692640e210 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:02.811067 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f439798-36cf-4159-98d8-7530412a9647', 'name': 'network-vif-deleted', 'tag': '3f1d41ae-f270-4229-8991-c6a9aa7b7b6c', 'status': 'completed', 'code': 200} Sep 03 11:33:02.845214 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-a71fe196-bd53-479c-b48f-9ccc2c7a5c31 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:02.847456 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-a71fe196-bd53-479c-b48f-9ccc2c7a5c31 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0580101 Sep 03 11:33:02.859422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'port': {'security_groups': ['f132ebc1-0d3b-402f-888c-c905d3a1e882', '6b3a8906-ea37-4516-8bdc-2bb514cd8ecf']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:33:02.929509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:03.160086 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:03.190450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:03.233723 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:03.274495 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.275113 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:03.276558 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d25f1d70-6780-4f11-9e1c-7444e9ad5d3c req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "PUT /v2.0/ports/0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 982 time: 0.4221606 Sep 03 11:33:03.280582 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:03.282454 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16fd8e22-03a9-4d7b-8868-87135eafe992" -d '{"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:03.357722 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-292288e6-f69d-4c34-b051-35c4ac8903de tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=6']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:03.400351 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bde6c1e-0df3-4cde-a5fc-be8f2f2addbe req-5dc65f1c-b5f6-47b3-a8c4-c9d01e5a88dc tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.402918 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9bde6c1e-0df3-4cde-a5fc-be8f2f2addbe req-5dc65f1c-b5f6-47b3-a8c4-c9d01e5a88dc tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.1111794 Sep 03 11:33:03.418093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bf014f-4e48-40a0-8d1d-a328a3e8a2e2 req-b76137e5-6ae9-4840-8215-0172bfea97a4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.418255 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:03.420145 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-45bf014f-4e48-40a0-8d1d-a328a3e8a2e2 req-b76137e5-6ae9-4840-8215-0172bfea97a4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0774081 Sep 03 11:33:03.478532 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9bde6c1e-0df3-4cde-a5fc-be8f2f2addbe req-b5400e0a-45ef-489e-b1b9-82c635bcc904 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693195 Sep 03 11:33:03.483196 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-45bf014f-4e48-40a0-8d1d-a328a3e8a2e2 req-2ae2a561-b3fd-4eb9-9ef9-b43df88d10d2 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0556307 Sep 03 11:33:03.524310 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c723be47-76ed-49d9-9f5c-52ae41678ca9 x-openstack-request-id: req-c723be47-76ed-49d9-9f5c-52ae41678ca9 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:03.524598 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:03.524842 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c723be47-76ed-49d9-9f5c-52ae41678ca9 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:03.525229 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:33:03.573423 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e18d6288-13cd-4ac9-b420-16d037c63d91 None None] Provisioning complete for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:33:03.573747 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e18d6288-13cd-4ac9-b420-16d037c63d91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:03.608039 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-7abd9150-e2c9-45c4-aec6-1ecaf3eb3e5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.609558 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-7abd9150-e2c9-45c4-aec6-1ecaf3eb3e5e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1138 time: 0.0462790 Sep 03 11:33:03.719414 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-7133ea76-65d1-4764-986a-d63e71dc84ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.720910 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-7133ea76-65d1-4764-986a-d63e71dc84ed service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.1013205 Sep 03 11:33:03.845325 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0740ae29-35b3-4b7e-99bb-8bfb31b05012 req-88b2d4ec-b01a-4264-a235-382e099382eb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:03.847587 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0740ae29-35b3-4b7e-99bb-8bfb31b05012 req-88b2d4ec-b01a-4264-a235-382e099382eb tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0825138 Sep 03 11:33:03.899681 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b925a4cf-8594-4543-ad0f-65b4248c6559 req-b8b1ec54-c795-4083-a388-ca840f0bfed5 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=7f439798-36cf-4159-98d8-7530412a9647 HTTP/1.1" status: 200 len: 210 time: 0.0345569 Sep 03 11:33:03.921114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0740ae29-35b3-4b7e-99bb-8bfb31b05012 req-e766c586-4d8b-4865-985d-7ccf93b6d665 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666752 Sep 03 11:33:04.071829 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-2325aa7c-59f1-46e7-a82a-6e5f8f4538fd service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 1001 time: 0.3326685 Sep 03 11:33:04.129385 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-16c6d2a6-c427-4f70-9880-1c0095bb9cf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:04.130831 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-16c6d2a6-c427-4f70-9880-1c0095bb9cf7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0436370 Sep 03 11:33:04.165923 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:04.188243 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-6d3a641b-3e00-4b7f-b534-9493dc024c01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:04.189638 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-6d3a641b-3e00-4b7f-b534-9493dc024c01 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0406048 Sep 03 11:33:04.288585 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-9cdae44e-156e-4ec8-a1af-34a6791e4b82 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874791 Sep 03 11:33:04.394775 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-16fd8e22-03a9-4d7b-8868-87135eafe992 req-ab86c326-4c09-4368-af2b-ef3dcd580f5a service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831378 Sep 03 11:33:04.596648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30288147-1165-479a-8fa0-3088658085e2 req-e2f44ebb-20b7-412c-a4ab-8aaf2ba10c34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:04.598088 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30288147-1165-479a-8fa0-3088658085e2 req-e2f44ebb-20b7-412c-a4ab-8aaf2ba10c34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0525987 Sep 03 11:33:04.634863 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-30288147-1165-479a-8fa0-3088658085e2 req-fef76c6f-d557-4146-95a8-6b567b817b35 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308573 Sep 03 11:33:05.036386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b7268a-7fe3-4d03-9956-a978efa6b97e req-d9353c55-8048-42cc-8cd5-465a6ffb1df3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:05.037769 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-17b7268a-7fe3-4d03-9956-a978efa6b97e req-d9353c55-8048-42cc-8cd5-465a6ffb1df3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0482666 Sep 03 11:33:05.077342 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-17b7268a-7fe3-4d03-9956-a978efa6b97e req-79652261-4517-4503-9a4d-b1467efc0c06 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327930 Sep 03 11:33:05.747844 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e048cc-342e-4758-9dd7-6c7f713a7a9f req-9bf4ce96-0b58-459a-a0f6-1bd229727e93 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:05.749338 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9e048cc-342e-4758-9dd7-6c7f713a7a9f req-9bf4ce96-0b58-459a-a0f6-1bd229727e93 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0480971 Sep 03 11:33:05.750224 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:33:05.770610 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:33:05.774708 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 3f1d41ae-f270-4229-8991-c6a9aa7b7b6c not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:33:05.788513 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9e048cc-342e-4758-9dd7-6c7f713a7a9f req-85a0ac93-a45a-4549-8851-05272991e080 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327258 Sep 03 11:33:06.531905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f77996-255b-4a0a-b4ea-9cd6e57782d4 req-7d7f6000-f862-4eb8-ba4b-9f34fd93589a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:06.533386 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0f77996-255b-4a0a-b4ea-9cd6e57782d4 req-7d7f6000-f862-4eb8-ba4b-9f34fd93589a tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0539250 Sep 03 11:33:06.578913 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f0f77996-255b-4a0a-b4ea-9cd6e57782d4 req-5da9c09a-fbab-42da-b70a-14220b36f429 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393114 Sep 03 11:33:06.656738 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28dd3888-a7f7-4501-8d9f-53ca62787931 req-9a9a0327-7fad-43ea-9e98-fcfa00f4f299 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:06.658199 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28dd3888-a7f7-4501-8d9f-53ca62787931 req-9a9a0327-7fad-43ea-9e98-fcfa00f4f299 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.0483637 Sep 03 11:33:06.695970 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28dd3888-a7f7-4501-8d9f-53ca62787931 req-b36ef7f1-5052-45e4-9599-adcfabc7be4a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316584 Sep 03 11:33:06.904045 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531131e9-5963-4247-9e97-63b860e8f684 req-fd0101f3-ff7a-4416-b804-2c098a310c97 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:06.905631 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-531131e9-5963-4247-9e97-63b860e8f684 req-fd0101f3-ff7a-4416-b804-2c098a310c97 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0495427 Sep 03 11:33:06.944228 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-531131e9-5963-4247-9e97-63b860e8f684 req-b731f6ad-a97d-4a59-ad2d-a35f3079f1cb tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324099 Sep 03 11:33:07.701901 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cc324dc-a9b2-4ec0-9ff2-7e765ef17cea req-e66db33e-d3b6-48ee-b533-a77348276a5c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:07.704016 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3cc324dc-a9b2-4ec0-9ff2-7e765ef17cea req-e66db33e-d3b6-48ee-b533-a77348276a5c tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0558665 Sep 03 11:33:07.746339 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3cc324dc-a9b2-4ec0-9ff2-7e765ef17cea req-dd208820-6606-4a72-bf50-751070f3134e tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/security-groups?id=9e7f4935-56b1-4330-857f-c652c7c14ed1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359299 Sep 03 11:33:07.847961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3791ac4-5d3e-4e40-bc87-bbc58170c1a2 req-881a4c09-22d2-43de-8eb3-3f763ba57a9b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:07.849474 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3791ac4-5d3e-4e40-bc87-bbc58170c1a2 req-881a4c09-22d2-43de-8eb3-3f763ba57a9b tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.0497651 Sep 03 11:33:07.888657 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3791ac4-5d3e-4e40-bc87-bbc58170c1a2 req-358eda13-aee8-4f39-bc31-d04d0f20a842 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325356 Sep 03 11:33:08.066953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adac0610-a25e-433b-b62d-92322c361f78 req-11055d5d-2f67-4ad4-ad6b-c9f9c47d2cf6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:08.068441 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-adac0610-a25e-433b-b62d-92322c361f78 req-11055d5d-2f67-4ad4-ad6b-c9f9c47d2cf6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0488429 Sep 03 11:33:08.106265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-adac0610-a25e-433b-b62d-92322c361f78 req-ffb1c4ce-7bf7-4023-a8df-e6c0f6d2ec63 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318315 Sep 03 11:33:08.345141 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-3640d24c-6248-4baf-a129-247195ec12b3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:08.346678 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-3640d24c-6248-4baf-a129-247195ec12b3 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 946 time: 0.0472147 Sep 03 11:33:08.442733 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Deleting port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:33:08.443075 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:08.532378 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] For port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,segment=NetworkSegment(06ffc106-b4b7-4f79-867c-120424c01651),segment_id=06ffc106-b4b7-4f79-867c-120424c01651)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:08.532658 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:08.545039 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Calling delete_port for a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:33:08.752607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:08.765012 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['a8d91691-2be6-4f9b-8c69-fcf5c734aaf4'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:08.783069 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Pushing event deleted for resources: {'Port': ['ID=a8d91691-2be6-4f9b-8c69-fcf5c734aaf4,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:08.834117 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] No DVR routers for this DVR port a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:33:08.836460 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:08.838455 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-95fe1a9f-88cc-4c27-90f1-5c50df4a7629 req-2d04f4cf-d620-4389-8948-cea93a245561 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.11 "DELETE /v2.0/ports/a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 HTTP/1.1" status: 204 len: 173 time: 0.4839547 Sep 03 11:33:08.838937 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'name': 'network-vif-deleted', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:08.842199 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6337448-0900-4670-bba5-75d2733e18f9" -d '{"events": [{"server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "name": "network-vif-deleted", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:08.855232 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c2872c99-dbfb-426a-bdba-dfdfede02d7b req-87f8ca67-3734-4980-93d8-ab73494b302b tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 210 time: 0.0362861 Sep 03 11:33:08.882122 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddf98735-0e5a-4e2d-80ea-3cb45699cf94 x-openstack-request-id: req-ddf98735-0e5a-4e2d-80ea-3cb45699cf94 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:08.882426 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "658a34fc-d1e1-45af-91f5-d3a57c309989", "name": "network-vif-deleted", "tag": "a8d91691-2be6-4f9b-8c69-fcf5c734aaf4", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:08.882697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ddf98735-0e5a-4e2d-80ea-3cb45699cf94 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:08.883053 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '658a34fc-d1e1-45af-91f5-d3a57c309989', 'name': 'network-vif-deleted', 'tag': 'a8d91691-2be6-4f9b-8c69-fcf5c734aaf4', 'status': 'completed', 'code': 200} Sep 03 11:33:08.949509 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-f89c63f6-69e5-4fc1-b613-f40151713b8a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:08.951383 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-f89c63f6-69e5-4fc1-b613-f40151713b8a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.0529037 Sep 03 11:33:09.026440 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e5add2-26e5-41cb-90ce-a118e9e13da4 req-18e1b88e-df29-4d38-b3a5-ba7df7b7edec tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:09.028819 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77e5add2-26e5-41cb-90ce-a118e9e13da4 req-18e1b88e-df29-4d38-b3a5-ba7df7b7edec tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 945 time: 0.0665550 Sep 03 11:33:09.068264 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77e5add2-26e5-41cb-90ce-a118e9e13da4 req-c9dcc866-ee43-40ac-bdfb-f427d2675eb0 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331547 Sep 03 11:33:09.074310 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Deleting port 221c6012-4b26-4d7d-b7e8-145356803449 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:33:09.074859 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:09.174648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] For port 221c6012-4b26-4d7d-b7e8-145356803449, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=221c6012-4b26-4d7d-b7e8-145356803449,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:09.175017 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:09.188056 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Calling delete_port for 221c6012-4b26-4d7d-b7e8-145356803449 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:33:09.227259 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3276ee51-b226-4421-8c65-7003a7ccdc76 req-054baf14-d9bd-4af3-9396-c900d6df6443 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:09.229068 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3276ee51-b226-4421-8c65-7003a7ccdc76 req-054baf14-d9bd-4af3-9396-c900d6df6443 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0531163 Sep 03 11:33:09.280168 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3276ee51-b226-4421-8c65-7003a7ccdc76 req-ad1ff751-9a05-4276-9aa0-d3cbc25e6a6f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429447 Sep 03 11:33:09.375684 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4999c89c-a252-4bb5-96fd-0a2e7331b4aa req-a11b4bd7-e915-4530-a4d7-cf95dc03caca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:09.377073 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4999c89c-a252-4bb5-96fd-0a2e7331b4aa req-a11b4bd7-e915-4530-a4d7-cf95dc03caca service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0405185 Sep 03 11:33:09.387254 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:09.401165 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8', 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', '221c6012-4b26-4d7d-b7e8-145356803449'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:09.416311 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event deleted for resources: {'Port': ['ID=221c6012-4b26-4d7d-b7e8-145356803449,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:09.423664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4999c89c-a252-4bb5-96fd-0a2e7331b4aa req-7833477b-2538-4ef4-b1d7-8168d29e33f8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376706 Sep 03 11:33:09.458665 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] No DVR routers for this DVR port 221c6012-4b26-4d7d-b7e8-145356803449 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:33:09.461121 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:09.463333 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-0fca1b58-f539-4cab-af27-93be153a3eb0 req-ee88b1e3-939a-444c-a866-eceb7be4e267 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "DELETE /v2.0/ports/221c6012-4b26-4d7d-b7e8-145356803449 HTTP/1.1" status: 204 len: 173 time: 0.5033238 Sep 03 11:33:09.954411 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d56fce9d-dd64-496f-a0c6-cac6813fbdc5 req-0c63f4e5-65a7-4597-89b7-9baf4b4f43e1 tempest-VolumesActionsTest-767050538 tempest-VolumesActionsTest-767050538-project] 10.222.0.16 "GET /v2.0/ports?device_id=658a34fc-d1e1-45af-91f5-d3a57c309989 HTTP/1.1" status: 200 len: 210 time: 0.0251315 Sep 03 11:33:10.176505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-73cba35a-6545-417f-a4c8-a8811271b24d req-9121a1c2-9574-4906-b099-48b776063024 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=150edc86-cc1a-4df7-a885-ae96ca2e37d6 HTTP/1.1" status: 200 len: 210 time: 0.0268719 Sep 03 11:33:10.386204 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e706ca-dca5-49f1-85c2-f5f19c8308e1 req-8d539f60-4b35-44c4-ad66-5509cbc529b0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:10.387783 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-57e706ca-dca5-49f1-85c2-f5f19c8308e1 req-8d539f60-4b35-44c4-ad66-5509cbc529b0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0736823 Sep 03 11:33:10.420880 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df14598-e24d-46af-9f9f-e6eacd86b08e req-f41a864f-711e-43b5-a9d6-b534409c5088 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:10.422318 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0df14598-e24d-46af-9f9f-e6eacd86b08e req-f41a864f-711e-43b5-a9d6-b534409c5088 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0753040 Sep 03 11:33:10.452021 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-57e706ca-dca5-49f1-85c2-f5f19c8308e1 req-fbda6b70-1629-4139-bd3b-207004a8b68e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580144 Sep 03 11:33:10.480547 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0df14598-e24d-46af-9f9f-e6eacd86b08e req-d42d7fd7-6803-4260-b18c-26e565bb9388 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473349 Sep 03 11:33:10.579182 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-2544a67f-04d7-4e01-9c01-1463103d623f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0421917 Sep 03 11:33:10.679342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-83499b9f-dbcd-42d4-af44-a78f417f9292 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:10.680866 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-83499b9f-dbcd-42d4-af44-a78f417f9292 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 1098 time: 0.0419860 Sep 03 11:33:10.788899 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-3144f5d4-0aa5-410a-9216-0c21569408f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:10.790479 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-3144f5d4-0aa5-410a-9216-0c21569408f1 service neutron] 10.222.0.11 "GET /v2.0/networks?id=778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 200 len: 916 time: 0.0872014 Sep 03 11:33:10.839404 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-ad1fdbe5-a6b0-4c3e-98a7-affbc47dc280 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 200 len: 217 time: 0.0364683 Sep 03 11:33:10.885277 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'name': 'network-vif-deleted', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:10.888160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fca4c196-6fb0-4d1c-976b-f98cdee072c0" -d '{"events": [{"server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "name": "network-vif-deleted", "tag": "221c6012-4b26-4d7d-b7e8-145356803449"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:10.906639 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-107db361-8c48-471f-b6d4-ce80fc18aac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:10.908175 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-107db361-8c48-471f-b6d4-ce80fc18aac6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 200 len: 855 time: 0.0499766 Sep 03 11:33:10.926581 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c9f59d1-c31a-408f-a7fd-783e73b6ca51 x-openstack-request-id: req-0c9f59d1-c31a-408f-a7fd-783e73b6ca51 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:10.926859 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "150edc86-cc1a-4df7-a885-ae96ca2e37d6", "name": "network-vif-deleted", "tag": "221c6012-4b26-4d7d-b7e8-145356803449", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:10.927099 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0c9f59d1-c31a-408f-a7fd-783e73b6ca51 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:10.927467 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '150edc86-cc1a-4df7-a885-ae96ca2e37d6', 'name': 'network-vif-deleted', 'tag': '221c6012-4b26-4d7d-b7e8-145356803449', 'status': 'completed', 'code': 200} Sep 03 11:33:10.945747 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-50361d70-b161-4903-90e5-1af563831404 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=778c15f4-3719-4d66-9e6d-1be38ac5cc42&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0277643 Sep 03 11:33:11.059373 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-33477902-6cd2-4dac-a3d1-f02dd139fa61 service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0979340 Sep 03 11:33:11.161911 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-99164ed6-2dcc-4481-9fad-0a357718b7d1 req-7ca94bd1-bafa-4a37-aa6e-2bec05560e7d service neutron] 10.222.0.11 "GET /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951953 Sep 03 11:33:11.568294 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85cdaa5-1d5b-41a4-ab03-792339400cc3 req-be186a38-45e7-41a0-b513-e90328dca576 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:11.569809 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b85cdaa5-1d5b-41a4-ab03-792339400cc3 req-be186a38-45e7-41a0-b513-e90328dca576 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0493634 Sep 03 11:33:11.636709 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b85cdaa5-1d5b-41a4-ab03-792339400cc3 req-ba09e102-7be7-4666-bcb0-0868d59d8032 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598035 Sep 03 11:33:11.652036 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-153b6996-e551-43c1-8eab-232da3fdb2d5 req-b6e5fe68-6002-45b3-b441-bf2688f36672 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:11.653693 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-153b6996-e551-43c1-8eab-232da3fdb2d5 req-b6e5fe68-6002-45b3-b441-bf2688f36672 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0751202 Sep 03 11:33:11.693062 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-153b6996-e551-43c1-8eab-232da3fdb2d5 req-66aad846-af24-451f-908f-4deeaab63c4f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335140 Sep 03 11:33:11.751891 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e767d70-6b34-40f3-9bf6-0d55c32dd461 req-cf1cc82f-8932-4050-87f4-0559f65c3a17 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:11.753519 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e767d70-6b34-40f3-9bf6-0d55c32dd461 req-cf1cc82f-8932-4050-87f4-0559f65c3a17 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0531163 Sep 03 11:33:11.770037 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:33:11.789892 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:33:11.790606 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a8d91691-2be6-4f9b-8c69-fcf5c734aaf4 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:33:11.791213 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 221c6012-4b26-4d7d-b7e8-145356803449 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:33:11.805248 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e767d70-6b34-40f3-9bf6-0d55c32dd461 req-f03f4e43-0178-498e-859e-ff93ff3e4a04 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451393 Sep 03 11:33:11.813503 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 221c6012-4b26-4d7d-b7e8-145356803449 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:33:11.814041 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 221c6012-4b26-4d7d-b7e8-145356803449 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:33:12.108364 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-382f42f4-251a-4e1d-b4b9-2584c132767a req-8b93f8b1-2173-4e5e-9ac8-6b0ef20f0061 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.109982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-382f42f4-251a-4e1d-b4b9-2584c132767a req-8b93f8b1-2173-4e5e-9ac8-6b0ef20f0061 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0505042 Sep 03 11:33:12.150264 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-382f42f4-251a-4e1d-b4b9-2584c132767a req-dc2711ed-8f13-4c27-b41b-b60991edb00b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341294 Sep 03 11:33:12.197783 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-fa2be816-544f-4677-9385-9fa55765d0a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.200007 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-fa2be816-544f-4677-9385-9fa55765d0a3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0583704 Sep 03 11:33:12.302996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-e8f2ab80-27b5-4157-be57-e3601b743a2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.304482 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-e8f2ab80-27b5-4157-be57-e3601b743a2f service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.0861850 Sep 03 11:33:12.350110 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-c5f05e8c-a781-42b9-b570-637e9495de4b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 217 time: 0.0370362 Sep 03 11:33:12.421326 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-2c82de5a-2d28-4e4d-9d63-f41923fc2d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.422989 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-2c82de5a-2d28-4e4d-9d63-f41923fc2d19 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0439129 Sep 03 11:33:12.459016 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-619ad98b-347d-4471-87aa-1349fd87eba2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234606 Sep 03 11:33:12.554984 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-f8e4bc29-b7a9-4d17-a87b-b190bd927a01 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833414 Sep 03 11:33:12.643943 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b4a681f-88a4-4baa-a65b-6e5d32d82b2f req-a0195fce-1344-4d9c-93d5-195a03b0180b service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802176 Sep 03 11:33:12.752657 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886549cd-e17f-432e-b3e7-ef6a30b774e4 req-1665e223-08a0-4ed8-a1ef-3c8a2323e000 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.754116 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-886549cd-e17f-432e-b3e7-ef6a30b774e4 req-1665e223-08a0-4ed8-a1ef-3c8a2323e000 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0472250 Sep 03 11:33:12.790460 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-886549cd-e17f-432e-b3e7-ef6a30b774e4 req-11e8e0f4-9ed1-47a8-bcf8-f39871c38055 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304937 Sep 03 11:33:12.924689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8cb1894-2808-4eb1-b128-8582ddf027c0 req-f74abc01-6bf6-45dd-85af-1927fe9f2490 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:12.926055 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8cb1894-2808-4eb1-b128-8582ddf027c0 req-f74abc01-6bf6-45dd-85af-1927fe9f2490 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0513639 Sep 03 11:33:12.963213 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8cb1894-2808-4eb1-b128-8582ddf027c0 req-db8b56d2-2ef3-497b-8594-6efee27af495 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312927 Sep 03 11:33:13.269163 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f484b40-efc6-46ed-96e8-5e01deca41aa req-b5e3d3dc-9b96-4cce-9dd3-4eb9e0155a6c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:13.270640 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f484b40-efc6-46ed-96e8-5e01deca41aa req-b5e3d3dc-9b96-4cce-9dd3-4eb9e0155a6c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0469043 Sep 03 11:33:13.307444 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f484b40-efc6-46ed-96e8-5e01deca41aa req-3ecbc55d-1cef-40fb-8f6d-9e6c5ee0a357 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310719 Sep 03 11:33:13.729686 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:13.902586 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12699b91-347b-471a-9419-cb34774e6bae req-87d7d3a4-5df5-41c7-8358-01ac73d70b96 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:13.904045 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12699b91-347b-471a-9419-cb34774e6bae req-87d7d3a4-5df5-41c7-8358-01ac73d70b96 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0468802 Sep 03 11:33:13.942068 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12699b91-347b-471a-9419-cb34774e6bae req-260efcf3-7ad3-4563-8e84-2168b7d15a41 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320990 Sep 03 11:33:14.090323 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29ea849-e061-405a-b2c0-65caa79d0999 req-26277064-ba07-45d0-aa56-fdff55f02c6c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:14.091800 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a29ea849-e061-405a-b2c0-65caa79d0999 req-26277064-ba07-45d0-aa56-fdff55f02c6c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0596526 Sep 03 11:33:14.129051 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a29ea849-e061-405a-b2c0-65caa79d0999 req-14c8a9de-d0cb-4be2-925e-40f0af4dbedc tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313299 Sep 03 11:33:14.422991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447fb5b8-1de4-448d-ac72-2fdd2bc9305c req-fc1167e8-d65e-4490-aa70-454689d5164b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:14.424447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-447fb5b8-1de4-448d-ac72-2fdd2bc9305c req-fc1167e8-d65e-4490-aa70-454689d5164b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0477455 Sep 03 11:33:14.462473 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-447fb5b8-1de4-448d-ac72-2fdd2bc9305c req-a4d12bbb-159f-402e-b036-3c5905f68cc8 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321095 Sep 03 11:33:15.055213 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06acd2f-8394-492e-8a4d-17db247652be req-e38ce250-f3fc-4202-a547-432c3c906241 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:15.056592 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a06acd2f-8394-492e-8a4d-17db247652be req-e38ce250-f3fc-4202-a547-432c3c906241 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0488071 Sep 03 11:33:15.094685 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a06acd2f-8394-492e-8a4d-17db247652be req-fbe04c95-f975-4094-95c9-4cb8f05bd579 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317221 Sep 03 11:33:15.243450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd6fdf1-64bc-4c6a-985d-8194e223daa7 req-65e93f76-c187-42a2-b1c9-c8954d65707a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:15.244886 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ddd6fdf1-64bc-4c6a-985d-8194e223daa7 req-65e93f76-c187-42a2-b1c9-c8954d65707a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0509875 Sep 03 11:33:15.283414 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ddd6fdf1-64bc-4c6a-985d-8194e223daa7 req-611df85f-473f-4270-b687-702f2d6ea4c8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321176 Sep 03 11:33:15.577007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3edd43-1a28-4cd4-90e0-3c1e97cf9f71 req-3451b8e0-9e73-43a2-9520-eceeb550bb13 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:15.578472 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd3edd43-1a28-4cd4-90e0-3c1e97cf9f71 req-3451b8e0-9e73-43a2-9520-eceeb550bb13 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0475562 Sep 03 11:33:15.614716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd3edd43-1a28-4cd4-90e0-3c1e97cf9f71 req-0be7ee5a-960a-4a5e-a125-c2c0ed6bf7cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303741 Sep 03 11:33:16.207484 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09f2b71-2264-41d3-a3d9-0ec4e9d36e32 req-0524b661-f74b-42cd-9a0a-2d1729faf236 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:16.208959 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e09f2b71-2264-41d3-a3d9-0ec4e9d36e32 req-0524b661-f74b-42cd-9a0a-2d1729faf236 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0492566 Sep 03 11:33:16.246052 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e09f2b71-2264-41d3-a3d9-0ec4e9d36e32 req-d3e69df0-95c2-4f86-9cb0-fee8ff9dff85 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305288 Sep 03 11:33:16.398483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1203ebcf-e280-4a0b-b3cf-b90c8198873e req-e87b32f8-bee3-4963-8e42-484235b9a03c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:16.399956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1203ebcf-e280-4a0b-b3cf-b90c8198873e req-e87b32f8-bee3-4963-8e42-484235b9a03c tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0518057 Sep 03 11:33:16.437694 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1203ebcf-e280-4a0b-b3cf-b90c8198873e req-8f0bef90-2ad2-440f-b4aa-67e9a06b58aa tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316920 Sep 03 11:33:16.511803 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-e2372baa-c713-4484-983b-342c3181b9f3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:16.513270 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-e2372baa-c713-4484-983b-342c3181b9f3 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 945 time: 0.0475655 Sep 03 11:33:16.612073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Deleting port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:33:16.620796 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:16.701189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] For port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:16.701614 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:16.723322 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Calling delete_port for f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:33:16.733676 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac8c1fa-1948-4675-96ac-73bfcd181865 req-6136dddd-eade-4192-a649-2caed72600f5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:16.735220 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eac8c1fa-1948-4675-96ac-73bfcd181865 req-6136dddd-eade-4192-a649-2caed72600f5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0531132 Sep 03 11:33:16.775721 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eac8c1fa-1948-4675-96ac-73bfcd181865 req-dad78f08-c9fd-4050-a069-ea8a0b450d6f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341668 Sep 03 11:33:16.918547 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:16.931253 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8', 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:16.949754 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event deleted for resources: {'Port': ['ID=f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:16.993502 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] No DVR routers for this DVR port f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:33:16.996318 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:16.998857 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-98d32f38-5868-4232-a46d-04f4b099fad2 req-512dfd5c-1b3a-4b93-a8aa-bef5fee81452 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "DELETE /v2.0/ports/f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 HTTP/1.1" status: 204 len: 173 time: 0.4781897 Sep 03 11:33:16.999347 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'name': 'network-vif-deleted', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:17.001599 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c99a44e8-0dc6-4521-9d49-f972fd8a44c2" -d '{"events": [{"server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "name": "network-vif-deleted", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:17.039910 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bbdf6b8-fe0d-4642-8024-fd5f670f669d x-openstack-request-id: req-0bbdf6b8-fe0d-4642-8024-fd5f670f669d {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:17.040204 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f876718-6a76-4c19-b7b5-dd8fb12f7cea", "name": "network-vif-deleted", "tag": "f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:17.040456 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0bbdf6b8-fe0d-4642-8024-fd5f670f669d {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:17.040856 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f876718-6a76-4c19-b7b5-dd8fb12f7cea', 'name': 'network-vif-deleted', 'tag': 'f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4', 'status': 'completed', 'code': 200} Sep 03 11:33:17.373264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2e7767-21b5-4304-a48b-8d0771da1520 req-47f3a489-797a-4d43-82fd-672674e0136f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:17.378859 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc2e7767-21b5-4304-a48b-8d0771da1520 req-47f3a489-797a-4d43-82fd-672674e0136f tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0584354 Sep 03 11:33:17.455408 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bc2e7767-21b5-4304-a48b-8d0771da1520 req-ebadef9f-9fee-4b6b-87d6-29eab7cc4ee8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733480 Sep 03 11:33:17.581528 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43c13728-cfd2-4ab4-915a-8c9334da7f56 req-b4c89cfc-b9ef-43cd-b18b-53a611817f9e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=9f876718-6a76-4c19-b7b5-dd8fb12f7cea HTTP/1.1" status: 200 len: 210 time: 0.0481253 Sep 03 11:33:17.910287 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a555b045-a32a-4b07-83f5-bcd38be58197 req-6c775e2e-dc25-4ca2-b090-131ec2823484 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:17.911808 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a555b045-a32a-4b07-83f5-bcd38be58197 req-6c775e2e-dc25-4ca2-b090-131ec2823484 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0523281 Sep 03 11:33:17.960468 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a555b045-a32a-4b07-83f5-bcd38be58197 req-f5f90cf4-fdaf-4d41-b426-54517e304fcb tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411215 Sep 03 11:33:18.732274 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885300b8-0b30-4160-ae6d-2788ca8ca963 req-fb766fa5-0c56-4ec8-b701-9eac027a67b8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:18.733905 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-885300b8-0b30-4160-ae6d-2788ca8ca963 req-fb766fa5-0c56-4ec8-b701-9eac027a67b8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.1004705 Sep 03 11:33:18.799578 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-885300b8-0b30-4160-ae6d-2788ca8ca963 req-bf6bf5c6-436e-44b3-a22b-e1271461f953 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579138 Sep 03 11:33:19.831440 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:33:19.871310 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:33:19.872133 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f39a3b6b-6c7b-461b-81cc-2f825e7fd6a4 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:33:19.893711 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f85360-6e7d-4295-b74d-a7ee6c524546 req-f522da94-f15d-485c-9bbc-1c414e06e501 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:19.895386 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-22f85360-6e7d-4295-b74d-a7ee6c524546 req-f522da94-f15d-485c-9bbc-1c414e06e501 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0543139 Sep 03 11:33:19.975501 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75455e82-fbc3-45ef-8d0d-d18060be59d5 req-571f0645-aeb5-4775-93a4-8004ecd89567 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:19.977014 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75455e82-fbc3-45ef-8d0d-d18060be59d5 req-571f0645-aeb5-4775-93a4-8004ecd89567 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0807407 Sep 03 11:33:19.980376 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-22f85360-6e7d-4295-b74d-a7ee6c524546 req-247570d2-d079-441c-94e7-4326d4aafa93 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735176 Sep 03 11:33:20.033398 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-75455e82-fbc3-45ef-8d0d-d18060be59d5 req-181ccae7-aff9-4bb8-8af1-a91e8e2b69a7 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493979 Sep 03 11:33:20.491081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ded1be3-f514-4e75-b7cb-fc08accadbd8 req-f38fd2e4-0901-48fe-b8f4-a3d350e89d7e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:20.492679 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3ded1be3-f514-4e75-b7cb-fc08accadbd8 req-f38fd2e4-0901-48fe-b8f4-a3d350e89d7e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0666602 Sep 03 11:33:20.538641 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3ded1be3-f514-4e75-b7cb-fc08accadbd8 req-b5450b82-5a16-469b-b5bf-48402f22951e tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363936 Sep 03 11:33:21.168109 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d183e6b6-95ab-4866-a573-2f3f4a3bfae6 req-21fb1344-7064-46ed-8834-19d516a627cc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:21.170584 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d183e6b6-95ab-4866-a573-2f3f4a3bfae6 req-21fb1344-7064-46ed-8834-19d516a627cc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0575640 Sep 03 11:33:21.228915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d183e6b6-95ab-4866-a573-2f3f4a3bfae6 req-cea34cfc-5610-4d8d-ae64-f0a987146323 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494921 Sep 03 11:33:21.675184 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223bba2d-5883-4865-b3ee-87bcc3948ada req-baf21752-c71e-4194-b3d2-e39bbe8d6aea tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:21.676786 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-223bba2d-5883-4865-b3ee-87bcc3948ada req-baf21752-c71e-4194-b3d2-e39bbe8d6aea tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0534151 Sep 03 11:33:21.719788 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-223bba2d-5883-4865-b3ee-87bcc3948ada req-156e87eb-a64b-47e6-aa10-16b7e516b90f tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368905 Sep 03 11:33:22.353666 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0d2fde-11ff-4428-bcfa-63d5a2b15064 req-c28e24d7-a9e5-4544-9dc3-64d76c0f4bb3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:22.355507 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea0d2fde-11ff-4428-bcfa-63d5a2b15064 req-c28e24d7-a9e5-4544-9dc3-64d76c0f4bb3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0511193 Sep 03 11:33:22.396740 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea0d2fde-11ff-4428-bcfa-63d5a2b15064 req-1f92321a-13e4-4224-9c30-79caf76332cc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353010 Sep 03 11:33:22.400899 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e854263-3046-48ad-9576-c075e803e9df req-07c3dfc6-d6c2-4a90-8e76-ac7a12337106 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:22.403826 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-9e854263-3046-48ad-9576-c075e803e9df req-07c3dfc6-d6c2-4a90-8e76-ac7a12337106 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0571563 Sep 03 11:33:22.511462 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Deleting port f7000a32-aed7-401d-8575-3a956bbb5eb8 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:33:22.512163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:22.610799 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] For port f7000a32-aed7-401d-8575-3a956bbb5eb8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f7000a32-aed7-401d-8575-3a956bbb5eb8,segment=NetworkSegment(a77ae87c-5482-4ebb-ba25-dda037bc3bbb),segment_id=a77ae87c-5482-4ebb-ba25-dda037bc3bbb)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:33:22.611171 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:22.625484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Calling delete_port for f7000a32-aed7-401d-8575-3a956bbb5eb8 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:33:22.843865 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:22.849947 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c6df730-5a93-4b83-9ee7-0dd6ab27cf87 req-4c6c28ab-7447-42c5-9a58-e204673251b8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:22.859234 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4c6df730-5a93-4b83-9ee7-0dd6ab27cf87 req-4c6c28ab-7447-42c5-9a58-e204673251b8 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/ports?device_id=ba83abf4-8e38-41e7-b793-3ad541e696b3 HTTP/1.1" status: 200 len: 945 time: 0.0681603 Sep 03 11:33:22.865190 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f7000a32-aed7-401d-8575-3a956bbb5eb8'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:33:22.874641 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Pushing event deleted for resources: {'Port': ['ID=f7000a32-aed7-401d-8575-3a956bbb5eb8,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:22.924388 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] No DVR routers for this DVR port f7000a32-aed7-401d-8575-3a956bbb5eb8 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:33:22.927110 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:22.929807 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-9e854263-3046-48ad-9576-c075e803e9df req-ae9005c7-673e-4be9-bd0e-02ea518cef21 tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.11 "DELETE /v2.0/ports/f7000a32-aed7-401d-8575-3a956bbb5eb8 HTTP/1.1" status: 204 len: 173 time: 0.5174625 Sep 03 11:33:22.930333 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'name': 'network-vif-deleted', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:33:22.935002 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa8289a7-72b1-4198-85d9-423ead273da8" -d '{"events": [{"server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "name": "network-vif-deleted", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:33:22.938878 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4c6df730-5a93-4b83-9ee7-0dd6ab27cf87 req-eb68eaf7-fb91-4d2d-9145-89ed4a86453a tempest-AttachVolumeNegativeTest-681170942 tempest-AttachVolumeNegativeTest-681170942-project] 10.222.0.16 "GET /v2.0/security-groups?id=b24b301c-ded5-47af-add6-32d0731d8740&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695348 Sep 03 11:33:22.992663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:33:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ad9b164-3c10-4a9d-9264-db56f695d827 x-openstack-request-id: req-4ad9b164-3c10-4a9d-9264-db56f695d827 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:33:22.992663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ba83abf4-8e38-41e7-b793-3ad541e696b3", "name": "network-vif-deleted", "tag": "f7000a32-aed7-401d-8575-3a956bbb5eb8", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:33:22.992663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4ad9b164-3c10-4a9d-9264-db56f695d827 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:33:22.992663 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba83abf4-8e38-41e7-b793-3ad541e696b3', 'name': 'network-vif-deleted', 'tag': 'f7000a32-aed7-401d-8575-3a956bbb5eb8', 'status': 'completed', 'code': 200} Sep 03 11:33:23.518929 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7169e6a1-1151-4885-a65c-e2f365720db1 req-73b7f022-4d89-450d-aeec-bcacf80c76ac tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:23.520423 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7169e6a1-1151-4885-a65c-e2f365720db1 req-73b7f022-4d89-450d-aeec-bcacf80c76ac tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0507824 Sep 03 11:33:23.572103 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7169e6a1-1151-4885-a65c-e2f365720db1 req-8d29520a-869d-46b3-8b29-5829a28489b7 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437989 Sep 03 11:33:23.714306 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-54d1c198-f30b-4964-a876-6a967df64ce5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:23.998456 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36224) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:24.083620 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Deleting subnet c64b6662-4e29-47d5-96b7-4719ce1edb33 {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:33:24.096465 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.139739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.192878 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.331298 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.360803 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.365096 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/c64b6662-4e29-47d5-96b7-4719ce1edb33 HTTP/1.1" status: 204 len: 168 time: 0.3628349 Sep 03 11:33:24.366887 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36228) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:24.367544 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-713b27c7-29b1-4bc9-8ada-9ce1929adf88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c64b6662-4e29-47d5-96b7-4719ce1edb33,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:24.443756 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.528695 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.538991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['778c15f4-3719-4d66-9e6d-1be38ac5cc42']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:24.549115 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:24.549403 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a77ae87c-5482-4ebb-ba25-dda037bc3bbb') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:24.559116 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.574831 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.581411 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Releasing vlan 355 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:33:24.581727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:33:24.583452 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:33:24.712589 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52b8b994-164c-4409-a3f6-61c52e9ace21 req-fe3cc10c-c53b-4dfc-874c-cbffb2800f38 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:24.714691 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-52b8b994-164c-4409-a3f6-61c52e9ace21 req-fe3cc10c-c53b-4dfc-874c-cbffb2800f38 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0505807 Sep 03 11:33:24.719435 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.730775 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:24.734855 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] 10.222.0.16 "DELETE /v2.0/networks/778c15f4-3719-4d66-9e6d-1be38ac5cc42 HTTP/1.1" status: 204 len: 168 time: 0.3669200 Sep 03 11:33:24.748668 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2efd807c-f238-4cc8-9605-084af92b77d4 admin admin] Pushing event deleted for resources: {'Network': ['ID=778c15f4-3719-4d66-9e6d-1be38ac5cc42,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:24.796626 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-52b8b994-164c-4409-a3f6-61c52e9ace21 req-0b326277-d99e-4fb1-9c53-b573e3cb04da tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0751348 Sep 03 11:33:25.113594 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36238) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:25.158146 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e5b71d36-8c07-4d48-a908-3b31b0353ebb admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7b665fdb80b4480ca82ebd31568efb7c&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0418992 Sep 03 11:33:25.159358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36242) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:25.225429 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:25.250885 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:25.382593 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:25.385960 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:25.387808 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/b24b301c-ded5-47af-add6-32d0731d8740 HTTP/1.1" status: 204 len: 168 time: 0.2266808 Sep 03 11:33:25.396117 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bbdb5a5-8828-48b7-b511-4ddb0b25e48d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b24b301c-ded5-47af-add6-32d0731d8740,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:25.878716 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f7000a32-aed7-401d-8575-3a956bbb5eb8 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:33:25.903503 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: f7000a32-aed7-401d-8575-3a956bbb5eb8 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:33:25.904062 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f7000a32-aed7-401d-8575-3a956bbb5eb8 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:33:25.976908 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5747587d-7049-4ad2-9781-def895c7c18f req-b7c98a63-2f2c-4cee-b9e0-59fa1fd37f87 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:25.979845 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5747587d-7049-4ad2-9781-def895c7c18f req-b7c98a63-2f2c-4cee-b9e0-59fa1fd37f87 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0652275 Sep 03 11:33:26.020786 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5747587d-7049-4ad2-9781-def895c7c18f req-9f2e9be4-c1b2-4014-b843-91d7cc9a9117 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341680 Sep 03 11:33:26.348925 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-db4e2b24-9d2b-475d-ab0a-6822e1d4b352 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:26.572574 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b93e95-4eca-4d6c-9a49-bd17b19c162f req-005c822d-f458-4518-b448-490a8146119a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:26.574118 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43b93e95-4eca-4d6c-9a49-bd17b19c162f req-005c822d-f458-4518-b448-490a8146119a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0493898 Sep 03 11:33:26.628605 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43b93e95-4eca-4d6c-9a49-bd17b19c162f req-4859a797-2a4d-4e0a-9799-7343a2bcbfc5 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481534 Sep 03 11:33:26.697173 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:26.711398 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83673621-5157-4339-9836-8099ca6703bb req-9836780d-4fcd-4cd0-a105-882b5b9c8707 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:26.712933 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-9836780d-4fcd-4cd0-a105-882b5b9c8707 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 1099 time: 0.0566065 Sep 03 11:33:26.830890 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83673621-5157-4339-9836-8099ca6703bb req-55369c4a-0509-4d51-bdb1-e30bc38162bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:26.832835 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-55369c4a-0509-4d51-bdb1-e30bc38162bb service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.1119931 Sep 03 11:33:26.910065 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-e3894f10-ef58-4895-b411-3b2c78262ca9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 200 len: 1002 time: 0.0676425 Sep 03 11:33:26.990740 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83673621-5157-4339-9836-8099ca6703bb req-90272a95-42be-49a8-89b7-2684b93a2443 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:26.992498 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-90272a95-42be-49a8-89b7-2684b93a2443 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0505748 Sep 03 11:33:27.054092 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83673621-5157-4339-9836-8099ca6703bb req-f161243a-fe88-4a1d-a9a4-31d3c4168c97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:27.056048 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-f161243a-fe88-4a1d-a9a4-31d3c4168c97 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0517581 Sep 03 11:33:27.173015 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-82e2339f-97b6-400d-aac9-14497ae2da8e service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1069636 Sep 03 11:33:27.287791 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-83673621-5157-4339-9836-8099ca6703bb req-a8152624-af7e-4447-a75a-e0a6c82ca27b service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1029305 Sep 03 11:33:27.682802 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:27.814514 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f5fb2b-71cf-4338-a913-48278ed2b983 req-5f6afc9b-020e-49da-8059-e0b7cda8a0b1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:27.824465 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28f5fb2b-71cf-4338-a913-48278ed2b983 req-5f6afc9b-020e-49da-8059-e0b7cda8a0b1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0772314 Sep 03 11:33:27.883067 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28f5fb2b-71cf-4338-a913-48278ed2b983 req-b2153d2c-7b4f-4259-9ad2-fae1466ce8e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573583 Sep 03 11:33:29.050474 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fa6a23-3e11-46a2-a914-6047f785020b req-24e6f396-aee9-4f71-b6c8-ba2f6ae6393a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:29.051981 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7fa6a23-3e11-46a2-a914-6047f785020b req-24e6f396-aee9-4f71-b6c8-ba2f6ae6393a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0633137 Sep 03 11:33:29.083651 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:29.132542 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c7fa6a23-3e11-46a2-a914-6047f785020b req-fdd412d1-e8b9-4f4b-a12f-49dca04b07ce tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731642 Sep 03 11:33:29.216635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a559a28-7761-4092-9a76-f22bff7ca9ca req-e768b18b-2573-4bf2-9b9f-5a5d79c6ecc9 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:29.218555 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a559a28-7761-4092-9a76-f22bff7ca9ca req-e768b18b-2573-4bf2-9b9f-5a5d79c6ecc9 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0735104 Sep 03 11:33:29.271600 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a559a28-7761-4092-9a76-f22bff7ca9ca req-4b8c052e-815e-4c3f-b797-0b2d0d201d67 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463569 Sep 03 11:33:29.272163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-47bb301e-fa53-47ef-a771-4e81bf74c592 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:29.273777 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-47bb301e-fa53-47ef-a771-4e81bf74c592 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0481431 Sep 03 11:33:29.390510 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-aa3f0916-f232-4b19-b58a-e4f82ab46dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:29.392190 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-aa3f0916-f232-4b19-b58a-e4f82ab46dd7 service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.1097932 Sep 03 11:33:29.445751 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-953284ca-36e5-4891-b749-3096d607d8a6 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 217 time: 0.0447009 Sep 03 11:33:29.538080 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-4bd3d0ae-e408-474e-a2e6-a9008dc5a31b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:29.539492 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-4bd3d0ae-e408-474e-a2e6-a9008dc5a31b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0868988 Sep 03 11:33:29.614562 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-e9158d14-fec7-4c54-9f10-c3a8701f24c3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483711 Sep 03 11:33:29.731008 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-e756d6a8-4c2d-4196-9b15-04db7881b0c9 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1083281 Sep 03 11:33:29.831152 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fec23abb-7d92-4a09-8fe9-d1e611b5f56d req-44cb2ac9-a125-45cb-aac2-2d60913caa79 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918324 Sep 03 11:33:30.429229 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf98d0d7-e64f-4d65-8d8a-bb65c6ff3aa6 req-2c537873-d016-44cc-b18a-f9a7bd488473 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:30.431501 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf98d0d7-e64f-4d65-8d8a-bb65c6ff3aa6 req-2c537873-d016-44cc-b18a-f9a7bd488473 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0667553 Sep 03 11:33:30.479404 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf98d0d7-e64f-4d65-8d8a-bb65c6ff3aa6 req-2dd14223-17d6-468d-99cb-9f05dd8d4e57 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366189 Sep 03 11:33:31.609404 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-750b4012-53de-4eee-a042-402ad35683e1 req-c589f115-f764-4869-a4dd-261e3f8436d4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:31.610978 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-750b4012-53de-4eee-a042-402ad35683e1 req-c589f115-f764-4869-a4dd-261e3f8436d4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0591772 Sep 03 11:33:31.655136 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-750b4012-53de-4eee-a042-402ad35683e1 req-0cec677a-9b84-4c16-a771-8532b3c0f1b1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375972 Sep 03 11:33:32.797946 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06349f19-080e-4406-9744-7e63bc1f51cc req-13ce7f92-0224-4642-a003-43d981017367 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:32.800504 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06349f19-080e-4406-9744-7e63bc1f51cc req-13ce7f92-0224-4642-a003-43d981017367 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0814793 Sep 03 11:33:32.854940 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06349f19-080e-4406-9744-7e63bc1f51cc req-de9e0020-421b-4458-a3d3-fc2ce10443a7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468643 Sep 03 11:33:33.949759 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:33:33.965770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4ab104-1042-47d8-a330-32fa6287680f req-880538c0-7a83-4de9-9b11-b09acc7c7424 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:33.967302 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b4ab104-1042-47d8-a330-32fa6287680f req-880538c0-7a83-4de9-9b11-b09acc7c7424 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0496786 Sep 03 11:33:34.004591 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5b4ab104-1042-47d8-a330-32fa6287680f req-34fca826-4b12-4bc4-8e38-fc3ccae6f07f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314355 Sep 03 11:33:35.126487 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32e2ba1-f13f-4f1e-b3de-240ef9e61259 req-401227ff-896a-4bf1-ab8c-0653bcdb711b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:35.128375 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b32e2ba1-f13f-4f1e-b3de-240ef9e61259 req-401227ff-896a-4bf1-ab8c-0653bcdb711b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0542037 Sep 03 11:33:35.165283 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b32e2ba1-f13f-4f1e-b3de-240ef9e61259 req-10ff8d08-e81c-4f0a-9fef-0d5d39831760 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313389 Sep 03 11:33:35.925345 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de2f88b-9199-4dfb-8b93-1c762e89af5f req-45293fdd-b92d-4087-89d0-8ae7728ffc32 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:35.926834 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6de2f88b-9199-4dfb-8b93-1c762e89af5f req-45293fdd-b92d-4087-89d0-8ae7728ffc32 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0495644 Sep 03 11:33:35.968318 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6de2f88b-9199-4dfb-8b93-1c762e89af5f req-27b359fd-69b4-4254-95af-ea476eb5e799 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0351641 Sep 03 11:33:36.204644 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-f80e15e9-05b8-4d79-8ed7-36283bd748c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:36.206163 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-f80e15e9-05b8-4d79-8ed7-36283bd748c7 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1138 time: 0.2546382 Sep 03 11:33:36.290584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287235df-ee7b-4550-8d85-2d1987828a6a req-d8f10970-bc95-4093-a797-ddf39f5c8fb3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:36.292055 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-287235df-ee7b-4550-8d85-2d1987828a6a req-d8f10970-bc95-4093-a797-ddf39f5c8fb3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0497110 Sep 03 11:33:36.307888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-2bb33900-1b1b-44c7-8760-9afaf56f2d4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:36.310189 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-2bb33900-1b1b-44c7-8760-9afaf56f2d4f service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.0876305 Sep 03 11:33:36.335601 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-287235df-ee7b-4550-8d85-2d1987828a6a req-5ff66aff-a09a-439a-bc2b-e8417d4ac585 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373466 Sep 03 11:33:36.382001 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-44c0c6b5-d9b9-4e4d-a6cd-8003058c3b11 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 1001 time: 0.0633571 Sep 03 11:33:36.433954 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-cb9cd8ec-b492-4d08-b2f8-48ef2a37aff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:36.435459 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-cb9cd8ec-b492-4d08-b2f8-48ef2a37aff1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0449178 Sep 03 11:33:36.484125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-a13882a5-65b9-41f7-a83e-683e834417aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:36.485668 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-a13882a5-65b9-41f7-a83e-683e834417aa service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423865 Sep 03 11:33:36.580806 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-1f0299ae-1d48-4da9-bd3e-3e584ff26a1c service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865359 Sep 03 11:33:36.679042 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6a15529d-bef0-453e-af14-fbc0b3d9bcbf req-dd8fa4c0-fb14-4874-9cd3-16ec1fc6d359 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888851 Sep 03 11:33:37.094507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed151a72-8600-4e8d-85da-70a3d0b6b57e req-39a804ad-b48a-4469-a178-b879b222ac07 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:37.096029 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ed151a72-8600-4e8d-85da-70a3d0b6b57e req-39a804ad-b48a-4469-a178-b879b222ac07 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0561383 Sep 03 11:33:37.134678 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ed151a72-8600-4e8d-85da-70a3d0b6b57e req-6f2c1053-86a3-4c4a-bb88-e6f8858cf4ef tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0325685 Sep 03 11:33:37.449779 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872ff15a-e675-466e-8b49-d4b7688bd0c6 req-8f076bcb-0a1b-452f-ab36-b21452e03f0b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:37.451725 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-872ff15a-e675-466e-8b49-d4b7688bd0c6 req-8f076bcb-0a1b-452f-ab36-b21452e03f0b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0498652 Sep 03 11:33:37.491703 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-872ff15a-e675-466e-8b49-d4b7688bd0c6 req-d5312b9d-ae8c-43b4-b5ad-754863b020fd tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333109 Sep 03 11:33:37.649647 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36528) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:37.737177 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36534) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:37.776283 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3a278c35-2df3-441e-91fe-01aa84f19756 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:37.803471 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Deleting subnet 44fde28d-267c-4bed-b76b-3cabf5dda5a8 {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:33:37.807719 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:37.854825 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:37.914147 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:37.973394 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3a278c35-2df3-441e-91fe-01aa84f19756 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.033648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3a278c35-2df3-441e-91fe-01aa84f19756 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.068065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.081339 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-3a278c35-2df3-441e-91fe-01aa84f19756 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=6522af35e7804198af71729ae313b752&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4306216 Sep 03 11:33:38.084734 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36536) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:38.100788 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a278c35-2df3-441e-91fe-01aa84f19756 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08f87381-f65d-4284-8e7c-62ba9b5450ac,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:38.104610 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=44fde28d-267c-4bed-b76b-3cabf5dda5a8,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:38.116892 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.118668 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-2c00a988-5e95-4f51-a3b4-a09c49801385 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/44fde28d-267c-4bed-b76b-3cabf5dda5a8 HTTP/1.1" status: 204 len: 168 time: 0.3805034 Sep 03 11:33:38.122236 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36540) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:38.136679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.159598 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.198701 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.263120 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-985e3d29-bd49-4201-b49b-fbe5fb66aa92 req-8c26ebcf-31df-4143-ad66-45a6e4f1210c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:38.264611 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-985e3d29-bd49-4201-b49b-fbe5fb66aa92 req-8c26ebcf-31df-4143-ad66-45a6e4f1210c tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0523524 Sep 03 11:33:38.285002 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.291159 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.294344 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.295470 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/08f87381-f65d-4284-8e7c-62ba9b5450ac HTTP/1.1" status: 204 len: 168 time: 0.2094355 Sep 03 11:33:38.296108 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['82386b1b-1e2a-418d-8be9-a666ddcb7220']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:38.306800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '06ffc106-b4b7-4f79-867c-120424c01651') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:38.307099 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '06ffc106-b4b7-4f79-867c-120424c01651') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:33:38.315982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-985e3d29-bd49-4201-b49b-fbe5fb66aa92 req-e786efaf-ffb8-4e4a-8384-87c5cb36cee9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0450444 Sep 03 11:33:38.316684 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66927a1f-32e2-4de9-8ffe-dd5ade465bf9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08f87381-f65d-4284-8e7c-62ba9b5450ac,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:38.316959 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.333177 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.340425 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Releasing vlan 364 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:33:38.340711 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:33:38.346616 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:33:38.473747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.484236 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.486436 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] 10.222.0.16 "DELETE /v2.0/networks/82386b1b-1e2a-418d-8be9-a666ddcb7220 HTTP/1.1" status: 204 len: 168 time: 0.3630931 Sep 03 11:33:38.496113 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70a81eb6-e513-4bd6-9502-87cb18f6c3bd admin admin] Pushing event deleted for resources: {'Network': ['ID=82386b1b-1e2a-418d-8be9-a666ddcb7220,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:38.613832 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7476704-bd42-45c9-89e5-9c09660eeafe req-db419dd8-268b-4a31-a0da-581be076921b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:38.615831 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e7476704-bd42-45c9-89e5-9c09660eeafe req-db419dd8-268b-4a31-a0da-581be076921b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0576162 Sep 03 11:33:38.655537 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e7476704-bd42-45c9-89e5-9c09660eeafe req-ffc9eaca-cab5-4118-a278-cdf69b00b2af tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336096 Sep 03 11:33:38.854928 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36560) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:38.894345 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-59a92b7c-6108-4ad6-8c9d-3fe2ec5f2e48 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b669eeee0b744c35aee3612d15269920&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0382252 Sep 03 11:33:38.896811 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36562) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:38.945648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:38.967062 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:39.100996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:39.103716 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:39.104985 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9e7f4935-56b1-4330-857f-c652c7c14ed1 HTTP/1.1" status: 204 len: 168 time: 0.2072210 Sep 03 11:33:39.118540 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2416691-3d17-48e1-805d-27659f7cdcd2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e7f4935-56b1-4330-857f-c652c7c14ed1,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:39.437960 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261e2989-d841-4789-bfc5-e73ee44b9b26 req-a74e55b4-493b-498f-9cd1-f3cc79b55982 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:39.439911 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-261e2989-d841-4789-bfc5-e73ee44b9b26 req-a74e55b4-493b-498f-9cd1-f3cc79b55982 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0508728 Sep 03 11:33:39.486410 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-261e2989-d841-4789-bfc5-e73ee44b9b26 req-21397a98-bfb0-4e39-b35b-33243f3061fd tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0389783 Sep 03 11:33:39.786362 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca67e448-75ca-4973-9c59-0c371cfd157a req-83477834-1bb8-4ba8-ad2a-364621cfeb51 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:39.787848 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca67e448-75ca-4973-9c59-0c371cfd157a req-83477834-1bb8-4ba8-ad2a-364621cfeb51 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0506327 Sep 03 11:33:39.829128 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca67e448-75ca-4973-9c59-0c371cfd157a req-41fc7a4e-4199-489b-ba8b-03d2f2bf0f33 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346072 Sep 03 11:33:40.614506 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690c3ba5-8063-44e6-8b32-4cafce3a309f req-b47aba0a-6446-4329-9863-8d6c0027ca85 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:40.615985 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-690c3ba5-8063-44e6-8b32-4cafce3a309f req-b47aba0a-6446-4329-9863-8d6c0027ca85 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0486906 Sep 03 11:33:40.656133 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-690c3ba5-8063-44e6-8b32-4cafce3a309f req-df173e60-8414-4815-8bd9-1b8b7a045d69 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0340223 Sep 03 11:33:40.931590 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36636) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:40.967638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef8a6f3-66af-4228-8e62-dd0cad2525d6 req-4f7dec25-6dc6-4b43-84e7-24b02b26bbb3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:40.969128 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ef8a6f3-66af-4228-8e62-dd0cad2525d6 req-4f7dec25-6dc6-4b43-84e7-24b02b26bbb3 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0531247 Sep 03 11:33:41.008250 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ef8a6f3-66af-4228-8e62-dd0cad2525d6 req-9ce9f509-7d0e-49d7-a3b7-1094e48863d9 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331695 Sep 03 11:33:41.030788 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-185acceb-d955-42c4-ad00-12397fca1ca7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.115297 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-185acceb-d955-42c4-ad00-12397fca1ca7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.192380 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-185acceb-d955-42c4-ad00-12397fca1ca7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.231232 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-185acceb-d955-42c4-ad00-12397fca1ca7 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=37c5d90ec15e4b9c855d84fdce24251c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3066502 Sep 03 11:33:41.233294 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185acceb-d955-42c4-ad00-12397fca1ca7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9db2d04e-608a-4237-bf6d-77b5e64f79b2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:41.233919 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36640) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:41.286360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.307166 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.337633 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36644) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:41.434704 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.437102 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.438144 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9db2d04e-608a-4237-bf6d-77b5e64f79b2 HTTP/1.1" status: 204 len: 168 time: 0.2031841 Sep 03 11:33:41.449514 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4de56f4-c333-46be-b2af-659a4e0f546c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.457282 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-534ee65e-d1bb-4502-8bdc-04df79617793 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9db2d04e-608a-4237-bf6d-77b5e64f79b2,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:41.543285 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4de56f4-c333-46be-b2af-659a4e0f546c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.622009 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d4de56f4-c333-46be-b2af-659a4e0f546c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.660540 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d4de56f4-c333-46be-b2af-659a4e0f546c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=84b976fb7626449bafc17d0d25536826&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3218682 Sep 03 11:33:41.661478 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4de56f4-c333-46be-b2af-659a4e0f546c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32603ec1-1af6-4a43-ae22-57003765839d,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:41.663484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36650) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:41.721694 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.746510 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.785638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029bc168-c860-4de6-8338-9d8751a0f08a req-5d6ec821-2144-4db4-8503-22fcc8b838dc tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:41.787422 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-029bc168-c860-4de6-8338-9d8751a0f08a req-5d6ec821-2144-4db4-8503-22fcc8b838dc tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0569117 Sep 03 11:33:41.830692 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-029bc168-c860-4de6-8338-9d8751a0f08a req-519c7f45-bbf3-4763-a2fd-120b5eba49ad tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0365927 Sep 03 11:33:41.868062 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.870757 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:41.872078 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/32603ec1-1af6-4a43-ae22-57003765839d HTTP/1.1" status: 204 len: 168 time: 0.2073791 Sep 03 11:33:41.880396 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eca87851-820b-4398-aa60-fdfd322d57f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32603ec1-1af6-4a43-ae22-57003765839d,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:42.121661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f9c589-4339-489c-9cb1-e10a46096fb7 req-b6694d3b-6b7f-4044-ac40-605e82a750a4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:42.123135 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e0f9c589-4339-489c-9cb1-e10a46096fb7 req-b6694d3b-6b7f-4044-ac40-605e82a750a4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0475276 Sep 03 11:33:42.160716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e0f9c589-4339-489c-9cb1-e10a46096fb7 req-f9de5535-74bf-4c57-9404-4312c93a4b56 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316291 Sep 03 11:33:42.518246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36660) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:42.532303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c5ede4bf-01b0-42e9-b481-228695842449 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.618831 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c5ede4bf-01b0-42e9-b481-228695842449 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.684952 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c5ede4bf-01b0-42e9-b481-228695842449 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.723752 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c5ede4bf-01b0-42e9-b481-228695842449 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7b21e40a0c4041c191951dce76f661cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2043750 Sep 03 11:33:42.724850 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ede4bf-01b0-42e9-b481-228695842449 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0583907a-901c-4b71-901f-9b6b610a0539,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:42.726553 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36662) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:42.773545 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.795577 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.929995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.932507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:42.934103 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0583907a-901c-4b71-901f-9b6b610a0539 HTTP/1.1" status: 204 len: 168 time: 0.2064919 Sep 03 11:33:42.945314 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f55bde-f09a-4b82-9c38-bea04a6fed7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0583907a-901c-4b71-901f-9b6b610a0539,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:42.963451 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e81dd35-e2eb-4a55-b3ad-fe6da3f60d33 req-6f075432-8a62-482d-aa12-35ef1fa7c17f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:42.965252 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1e81dd35-e2eb-4a55-b3ad-fe6da3f60d33 req-6f075432-8a62-482d-aa12-35ef1fa7c17f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0659316 Sep 03 11:33:43.006445 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1e81dd35-e2eb-4a55-b3ad-fe6da3f60d33 req-b8e80210-1f80-404b-a468-8287567ba210 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0350935 Sep 03 11:33:43.284189 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d23265-dcd6-42bf-ba10-1b3732e6d16b req-53d2dd8a-11f2-44eb-b8f0-c28269207066 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:43.285702 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25d23265-dcd6-42bf-ba10-1b3732e6d16b req-53d2dd8a-11f2-44eb-b8f0-c28269207066 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0496552 Sep 03 11:33:43.323583 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25d23265-dcd6-42bf-ba10-1b3732e6d16b req-749dd3c1-17a6-4867-84e5-9d98a5c9c037 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319445 Sep 03 11:33:43.719635 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:44.137824 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add602a1-4a7a-489b-8239-cae0138d24af req-c561dc1b-d3c9-44e6-8a6a-65fddc1a5062 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:44.139400 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-add602a1-4a7a-489b-8239-cae0138d24af req-c561dc1b-d3c9-44e6-8a6a-65fddc1a5062 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0500362 Sep 03 11:33:44.178603 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-add602a1-4a7a-489b-8239-cae0138d24af req-0a8216e6-988f-4de5-83eb-9997a8bf163a tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0332966 Sep 03 11:33:44.677032 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1508014-ec31-4650-81bb-19f22306d370 req-913d0785-7974-4757-a115-f0660c6f1b96 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:44.678585 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e1508014-ec31-4650-81bb-19f22306d370 req-913d0785-7974-4757-a115-f0660c6f1b96 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.2872980 Sep 03 11:33:44.717775 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e1508014-ec31-4650-81bb-19f22306d370 req-fab1a309-3988-4f6b-8d97-088f8a0679fe tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324464 Sep 03 11:33:45.292412 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07a612-4fda-46e8-adab-108c20f3a6f5 req-29f837bb-c8b9-4760-8456-0fe7bbd42940 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:45.294543 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef07a612-4fda-46e8-adab-108c20f3a6f5 req-29f837bb-c8b9-4760-8456-0fe7bbd42940 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0479555 Sep 03 11:33:45.333490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef07a612-4fda-46e8-adab-108c20f3a6f5 req-22c55e35-5277-41bb-9bf4-d01703563a7b tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0329130 Sep 03 11:33:45.650334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36744) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:45.754718 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-64ebca49-374e-46ef-bcde-3a4a347b0aef admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:45.835046 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e4137a-de9a-4ca2-b8ad-a1af7be62dab req-bd6a311d-a58e-4b48-892f-0165bc56cd71 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:45.836495 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a9e4137a-de9a-4ca2-b8ad-a1af7be62dab req-bd6a311d-a58e-4b48-892f-0165bc56cd71 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0484247 Sep 03 11:33:45.844104 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-64ebca49-374e-46ef-bcde-3a4a347b0aef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:45.874569 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a9e4137a-de9a-4ca2-b8ad-a1af7be62dab req-211bcb00-c345-4044-8054-a84453407bca tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313399 Sep 03 11:33:45.907652 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-64ebca49-374e-46ef-bcde-3a4a347b0aef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:45.947016 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-64ebca49-374e-46ef-bcde-3a4a347b0aef admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b0cd08ad216841cc935b123f48f2094a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2955930 Sep 03 11:33:45.947949 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ebca49-374e-46ef-bcde-3a4a347b0aef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa7194b5-0413-431d-9fa1-59cf3eba53e1,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:45.949710 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36750) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:46.000533 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.024576 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.140679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.143195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.144330 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/aa7194b5-0413-431d-9fa1-59cf3eba53e1 HTTP/1.1" status: 204 len: 168 time: 0.1929898 Sep 03 11:33:46.152664 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f92ca9-2100-4153-92d9-2dcc6268c068 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa7194b5-0413-431d-9fa1-59cf3eba53e1,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:46.449545 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a953aa0-e91a-4513-8f8a-2ab254b263e0 req-77ecc8c9-eb0c-42d3-9557-8f878035c664 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:46.451225 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3a953aa0-e91a-4513-8f8a-2ab254b263e0 req-77ecc8c9-eb0c-42d3-9557-8f878035c664 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0492091 Sep 03 11:33:46.490126 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3a953aa0-e91a-4513-8f8a-2ab254b263e0 req-6bdf694a-2a4c-4073-ab12-6ce1b6af1622 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0329034 Sep 03 11:33:46.788959 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36758) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:46.802947 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ffbd152b-b379-4db7-bbf7-5c9e39350b3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.886770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ffbd152b-b379-4db7-bbf7-5c9e39350b3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:46.988717 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d8723e-c9ca-42d2-b316-fff8b8ca760d req-972a2bad-88dc-4865-a911-a229c3d48c77 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:46.990060 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1d8723e-c9ca-42d2-b316-fff8b8ca760d req-972a2bad-88dc-4865-a911-a229c3d48c77 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0505037 Sep 03 11:33:46.991137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ffbd152b-b379-4db7-bbf7-5c9e39350b3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:47.045289 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ffbd152b-b379-4db7-bbf7-5c9e39350b3c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a09a89ffa2f44b0e8a1f650a5fd7063b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2551107 Sep 03 11:33:47.048165 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36762) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:33:47.052605 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbd152b-b379-4db7-bbf7-5c9e39350b3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22c474ec-e9d0-4698-97f3-29a392e37789,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:47.063057 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c1d8723e-c9ca-42d2-b316-fff8b8ca760d req-83afacc8-f519-4f8d-9a1e-494697024a4f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616572 Sep 03 11:33:47.098561 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:47.119142 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:47.245156 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:47.248177 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:47.249316 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/22c474ec-e9d0-4698-97f3-29a392e37789 HTTP/1.1" status: 204 len: 168 time: 0.2001646 Sep 03 11:33:47.256935 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbb91578-34b3-4f94-891b-e74a98021244 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22c474ec-e9d0-4698-97f3-29a392e37789,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:33:47.616037 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bca353-c9c2-44e0-9e8c-60338b670475 req-5404de0c-363e-4af9-ac54-dfd683b4f1e7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:47.617563 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1bca353-c9c2-44e0-9e8c-60338b670475 req-5404de0c-363e-4af9-ac54-dfd683b4f1e7 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0520227 Sep 03 11:33:47.663199 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1bca353-c9c2-44e0-9e8c-60338b670475 req-5fbc5476-5a51-402c-a801-2413936bab99 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0385196 Sep 03 11:33:48.180435 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a95c38b-ae13-435c-9fa3-1e81d4d85335 req-dc89d206-3ae9-4eed-a11f-5abc671e64c5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:48.181896 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a95c38b-ae13-435c-9fa3-1e81d4d85335 req-dc89d206-3ae9-4eed-a11f-5abc671e64c5 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0506697 Sep 03 11:33:48.220367 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a95c38b-ae13-435c-9fa3-1e81d4d85335 req-f145dfbc-acb0-4d7e-83d0-43c2498f903e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322652 Sep 03 11:33:48.776003 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1fa1a58-8bff-48f0-9609-5376f0e963ae req-924aef6b-d755-4783-8b4d-1784b2c4c95d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:48.777550 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a1fa1a58-8bff-48f0-9609-5376f0e963ae req-924aef6b-d755-4783-8b4d-1784b2c4c95d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0486968 Sep 03 11:33:48.817811 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a1fa1a58-8bff-48f0-9609-5376f0e963ae req-27ad8f83-b96c-4f44-9eeb-8d3714ba6e2f tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&id=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0342255 Sep 03 11:33:49.337679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef07a07d-5121-4b10-bc3a-b38a9376ef76 req-5a15b478-b142-4036-a739-5f107b2eedd1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:49.339265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef07a07d-5121-4b10-bc3a-b38a9376ef76 req-5a15b478-b142-4036-a739-5f107b2eedd1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0505178 Sep 03 11:33:49.378331 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef07a07d-5121-4b10-bc3a-b38a9376ef76 req-37390f0c-6b5e-41c7-b1e4-6320e345934b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324526 Sep 03 11:33:50.499493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd575083-0e59-4c56-a4e0-ad2423cd2e39 req-2243cf7e-124a-43e5-a2c8-494cc074fb60 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:50.501072 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd575083-0e59-4c56-a4e0-ad2423cd2e39 req-2243cf7e-124a-43e5-a2c8-494cc074fb60 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0537777 Sep 03 11:33:50.540541 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dd575083-0e59-4c56-a4e0-ad2423cd2e39 req-fbfe3a63-fbcc-4692-8b5c-99c572b42aa4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332351 Sep 03 11:33:51.656546 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc19c80-bbcb-4c6c-b26d-255196dc58f5 req-4419b879-b9d8-40ec-aecb-d02f262db298 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:51.658290 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dfc19c80-bbcb-4c6c-b26d-255196dc58f5 req-4419b879-b9d8-40ec-aecb-d02f262db298 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0484285 Sep 03 11:33:51.697852 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dfc19c80-bbcb-4c6c-b26d-255196dc58f5 req-4c6738f0-8b10-4a68-8477-3286d35a0d2d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335855 Sep 03 11:33:52.816051 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4beb75a0-81d5-4450-9e61-6311be632098 req-019f0d84-cb9b-48a7-9db5-966ebac4e6ad tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:52.817515 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4beb75a0-81d5-4450-9e61-6311be632098 req-019f0d84-cb9b-48a7-9db5-966ebac4e6ad tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0503035 Sep 03 11:33:52.854403 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4beb75a0-81d5-4450-9e61-6311be632098 req-32cc2038-867f-48e2-b909-64a5e023a32d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309107 Sep 03 11:33:53.696541 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2137830a-12c8-402a-89e4-fc61a4cc17e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:53.976292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33cda19-e206-42b7-9d15-17b31f96bd99 req-a2720658-daeb-4fe3-82d5-2e87fc7549e1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:53.977757 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d33cda19-e206-42b7-9d15-17b31f96bd99 req-a2720658-daeb-4fe3-82d5-2e87fc7549e1 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0530872 Sep 03 11:33:54.015659 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d33cda19-e206-42b7-9d15-17b31f96bd99 req-e1c4d7a6-3d42-43fa-974e-715258954d42 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313859 Sep 03 11:33:55.140212 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c0db26-7642-4f58-b3e7-d425868b2bc0 req-03d93761-d178-41b7-af50-0a26403e0b08 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:55.141777 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-96c0db26-7642-4f58-b3e7-d425868b2bc0 req-03d93761-d178-41b7-af50-0a26403e0b08 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0514050 Sep 03 11:33:55.180321 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-96c0db26-7642-4f58-b3e7-d425868b2bc0 req-16da0878-e325-4427-aef8-0f71426291be tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325441 Sep 03 11:33:56.313265 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df834d8-0d27-4f33-9bfb-3690ba4b2439 req-4a832da6-f3f8-4a38-bc69-dcede082a0ce tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:56.315011 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1df834d8-0d27-4f33-9bfb-3690ba4b2439 req-4a832da6-f3f8-4a38-bc69-dcede082a0ce tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0616012 Sep 03 11:33:56.352068 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fbfb3c-a6de-4546-82dd-8471802b7c9d req-6325b841-13c3-4b90-bdc4-d228a16b78eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:56.353544 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-27fbfb3c-a6de-4546-82dd-8471802b7c9d req-6325b841-13c3-4b90-bdc4-d228a16b78eb service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0414405 Sep 03 11:33:56.356412 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1df834d8-0d27-4f33-9bfb-3690ba4b2439 req-62a50c91-b614-472b-9498-1c02bbbeace7 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352409 Sep 03 11:33:56.389635 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-27fbfb3c-a6de-4546-82dd-8471802b7c9d req-d9a4eaf0-7eb0-485f-ae77-532f0d794a0a service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0285501 Sep 03 11:33:56.409005 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-622fcdb4-fee1-4c20-8eb7-23b74e31d0a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:56.694776 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:57.484518 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9c0925-f2fa-405d-80e7-97ce9c879233 req-3d35d7d4-d527-409a-a567-a75360926f43 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:57.487220 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1d9c0925-f2fa-405d-80e7-97ce9c879233 req-3d35d7d4-d527-409a-a567-a75360926f43 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0636392 Sep 03 11:33:57.527764 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1d9c0925-f2fa-405d-80e7-97ce9c879233 req-ceeefd23-0fe4-4d32-b56e-3e41c8fc4593 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348151 Sep 03 11:33:57.650902 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:58.648767 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb01b5f6-2cbd-47f3-bd07-f1f3d29790de req-b5f20397-4a38-4e16-a658-e17223ef3993 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:58.651834 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cb01b5f6-2cbd-47f3-bd07-f1f3d29790de req-b5f20397-4a38-4e16-a658-e17223ef3993 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0542397 Sep 03 11:33:58.691824 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cb01b5f6-2cbd-47f3-bd07-f1f3d29790de req-13a02b17-f82e-4518-a0ac-44ad5da131b4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338244 Sep 03 11:33:59.056730 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:33:59.186022 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd335ca8-969b-49d4-a46f-8ede8806e504 req-4353fb1b-eb7a-4e83-99e2-fd08b9831ac2 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:59.188042 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fd335ca8-969b-49d4-a46f-8ede8806e504 req-4353fb1b-eb7a-4e83-99e2-fd08b9831ac2 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0518820 Sep 03 11:33:59.231801 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fd335ca8-969b-49d4-a46f-8ede8806e504 req-1f8ef473-3492-4def-a3e5-2b5adf1bcd34 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357244 Sep 03 11:33:59.261629 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-6263da25-f832-4050-92ef-63e87667730d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:59.263212 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-6263da25-f832-4050-92ef-63e87667730d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 1098 time: 0.0464122 Sep 03 11:33:59.363702 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-49bd9b96-0b04-4d39-895d-1267fa582c7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:59.365142 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-49bd9b96-0b04-4d39-895d-1267fa582c7f service neutron] 10.222.0.11 "GET /v2.0/networks?id=29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 200 len: 919 time: 0.0942080 Sep 03 11:33:59.410551 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-8df7c4c7-b370-4531-8e35-c0812a44512c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 200 len: 217 time: 0.0363395 Sep 03 11:33:59.461884 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-1a3ce7c2-f1af-4e14-b981-0bcb5def56b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:33:59.463380 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-1a3ce7c2-f1af-4e14-b981-0bcb5def56b7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 200 len: 858 time: 0.0455952 Sep 03 11:33:59.500700 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-833b0051-ca8c-4c1c-bce9-e956f7e1254c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=29b4f20f-4a29-4a98-9a98-c60b1b87931c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290029 Sep 03 11:33:59.598156 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-90498992-8af5-4a11-aad4-926ad969262d service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899189 Sep 03 11:33:59.701513 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fb43766b-1bd9-4bdd-8e4b-82036466672f req-8c35efb1-05b2-48c3-991c-faf57963e165 service neutron] 10.222.0.11 "GET /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944099 Sep 03 11:34:00.364875 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d8ec8d-9440-4879-8b56-df3da1478399 req-03aad226-b174-4cb8-ae32-823139a8624b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:00.366340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99d8ec8d-9440-4879-8b56-df3da1478399 req-03aad226-b174-4cb8-ae32-823139a8624b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0564728 Sep 03 11:34:00.403997 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99d8ec8d-9440-4879-8b56-df3da1478399 req-94c3eaa7-be30-430d-b10b-c7895ee44e98 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316114 Sep 03 11:34:01.520261 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1fca24-4a1d-44ae-a047-147f1a1778a4 req-995e8aaa-bcef-42a8-827b-f684b54fb36c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:01.521746 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7c1fca24-4a1d-44ae-a047-147f1a1778a4 req-995e8aaa-bcef-42a8-827b-f684b54fb36c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0492013 Sep 03 11:34:01.559907 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7c1fca24-4a1d-44ae-a047-147f1a1778a4 req-6e7dc836-2c1f-4c0e-8446-31b2b41df22a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320356 Sep 03 11:34:02.670513 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a78cc9-d576-44b1-a89b-23d3a139b67a req-76e6646c-3868-45e1-b999-b9d4221a440d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:02.671965 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9a78cc9-d576-44b1-a89b-23d3a139b67a req-76e6646c-3868-45e1-b999-b9d4221a440d tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0475636 Sep 03 11:34:02.709826 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9a78cc9-d576-44b1-a89b-23d3a139b67a req-a920f83f-4333-4114-b3f3-df31b216ac73 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310602 Sep 03 11:34:07.180607 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6381bea9-8bd5-4564-9792-43a6c0c2a476 req-380585d4-bd49-479a-b31d-1cfd19332e8a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:07.182101 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6381bea9-8bd5-4564-9792-43a6c0c2a476 req-380585d4-bd49-479a-b31d-1cfd19332e8a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0543201 Sep 03 11:34:07.220795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6381bea9-8bd5-4564-9792-43a6c0c2a476 req-bbf3699c-8a9e-428a-8734-ef2ba890d45c tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324585 Sep 03 11:34:08.334605 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72da4032-97c5-4af6-9122-4fc017d896ea req-875f2a9b-008d-4779-a004-ce4c21fd8331 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:08.335975 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72da4032-97c5-4af6-9122-4fc017d896ea req-875f2a9b-008d-4779-a004-ce4c21fd8331 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0480416 Sep 03 11:34:08.372873 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72da4032-97c5-4af6-9122-4fc017d896ea req-687fe7b1-c7e9-4f57-8713-a2168d5ed490 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310626 Sep 03 11:34:08.964913 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 36986) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:09.067683 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.152726 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.238452 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.277157 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8e920e5a5f1f4157b39717f6d94f36a7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3111892 Sep 03 11:34:09.278027 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30596f32-d165-400c-8c22-cf6f7bdfb356,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:09.279935 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 36990) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:09.285156 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.285508 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.285860 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.286177 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.286531 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.286863 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.287189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.287515 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.287836 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.288154 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.288472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.288790 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb001b9c-d94b-4d43-bf07-97010589a6bf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.330252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.351203 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.488097 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f551bb-dbb5-45c7-9f6c-355847cf0c7f req-13c614e5-7a98-4c30-939c-693060b4f1f4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:09.489560 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33f551bb-dbb5-45c7-9f6c-355847cf0c7f req-13c614e5-7a98-4c30-939c-693060b4f1f4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0512693 Sep 03 11:34:09.494277 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.496826 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.497883 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/30596f32-d165-400c-8c22-cf6f7bdfb356 HTTP/1.1" status: 204 len: 168 time: 0.2169302 Sep 03 11:34:09.513125 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30596f32-d165-400c-8c22-cf6f7bdfb356,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:09.529029 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.529378 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.529716 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.530048 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.530397 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.530728 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.531058 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.531384 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.531709 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.532033 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.532353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.532670 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d8d1b2c-1a8b-4c3d-bdaa-4c4057df4bfe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:09.553159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33f551bb-dbb5-45c7-9f6c-355847cf0c7f req-161683f5-c80a-4f0a-812c-0f6b31f40316 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541210 Sep 03 11:34:09.630106 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-6f697404-47e6-46ea-b8f0-abf77e7a4436 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:09.631592 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-6f697404-47e6-46ea-b8f0-abf77e7a4436 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 945 time: 0.0481908 Sep 03 11:34:09.735112 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Deleting port 1ec235e2-d042-4026-bdc2-da77b096452b {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:09.735231 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.825310 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] For port 1ec235e2-d042-4026-bdc2-da77b096452b, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1ec235e2-d042-4026-bdc2-da77b096452b,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:09.825677 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:09.842092 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Calling delete_port for 1ec235e2-d042-4026-bdc2-da77b096452b owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:10.107753 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:10.122504 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['8dba3504-1d0d-4e2a-9da3-d44f9f95684d', '1ec235e2-d042-4026-bdc2-da77b096452b'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:10.138780 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Pushing event deleted for resources: {'Port': ['ID=1ec235e2-d042-4026-bdc2-da77b096452b,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:10.186311 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] No DVR routers for this DVR port 1ec235e2-d042-4026-bdc2-da77b096452b on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:10.189571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:10.200244 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a54cdb21-4010-478d-a177-4537d2d8d43e req-5f9c6a0d-33dc-4b8a-a4e6-6457f59d16c6 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "DELETE /v2.0/ports/1ec235e2-d042-4026-bdc2-da77b096452b HTTP/1.1" status: 204 len: 173 time: 0.5534401 Sep 03 11:34:10.200244 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'name': 'network-vif-deleted', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:10.200244 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5469425a-23b7-45e4-8b8b-a979ab1f6ead" -d '{"events": [{"server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "name": "network-vif-deleted", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:10.231244 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8923ec02-2e04-4c3d-b5d0-e4a3970b319b x-openstack-request-id: req-8923ec02-2e04-4c3d-b5d0-e4a3970b319b {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:10.231533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f708893-5470-4377-adde-08d9db3a42e6", "name": "network-vif-deleted", "tag": "1ec235e2-d042-4026-bdc2-da77b096452b", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:10.231783 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-8923ec02-2e04-4c3d-b5d0-e4a3970b319b {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:10.232176 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f708893-5470-4377-adde-08d9db3a42e6', 'name': 'network-vif-deleted', 'tag': '1ec235e2-d042-4026-bdc2-da77b096452b', 'status': 'completed', 'code': 200} Sep 03 11:34:10.656119 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04416075-de92-4e3b-83a9-9fb570c3a8dc req-481774ef-feef-467c-b7c0-7568f3b939ea tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=2f708893-5470-4377-adde-08d9db3a42e6 HTTP/1.1" status: 200 len: 210 time: 0.0262861 Sep 03 11:34:10.949397 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:34:12.111173 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0914c235-6e39-4802-ad1c-6aff14c70202 req-5b9ffc6a-b5e3-47f1-a693-ce828649fe22 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:12.113318 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0914c235-6e39-4802-ad1c-6aff14c70202 req-5b9ffc6a-b5e3-47f1-a693-ce828649fe22 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0494385 Sep 03 11:34:12.155275 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0914c235-6e39-4802-ad1c-6aff14c70202 req-cdbae39b-607d-4014-8afd-568221c79817 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352738 Sep 03 11:34:12.715768 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e8bb60-2d9b-40c1-9e7b-33ccd7f30af0 req-603f830f-db91-4f13-810e-1f5fd2ca264a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:12.717383 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f7e8bb60-2d9b-40c1-9e7b-33ccd7f30af0 req-603f830f-db91-4f13-810e-1f5fd2ca264a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0572362 Sep 03 11:34:12.760882 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f7e8bb60-2d9b-40c1-9e7b-33ccd7f30af0 req-5151b8ba-9d16-4608-b282-494eef2e97e8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364654 Sep 03 11:34:13.271687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e866ac4-7f82-473c-9532-784039d4d8a0 req-e7af8e46-28af-499b-a198-1fad22e8af6a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.273157 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4e866ac4-7f82-473c-9532-784039d4d8a0 req-e7af8e46-28af-499b-a198-1fad22e8af6a tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0483658 Sep 03 11:34:13.311406 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4e866ac4-7f82-473c-9532-784039d4d8a0 req-f3da7215-f682-4d5c-8f32-eb0785a05914 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322950 Sep 03 11:34:13.630429 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-b25a0408-8808-4b52-8843-3774ddcf430f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401111 Sep 03 11:34:13.695855 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-7c09c5e0-9c81-497c-916f-cfbd23641088 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.697311 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-7c09c5e0-9c81-497c-916f-cfbd23641088 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1138 time: 0.0402818 Sep 03 11:34:13.724288 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:13.811579 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-4b9552dd-1aef-41b3-9c3a-ef7b53a1178f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.813149 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-4b9552dd-1aef-41b3-9c3a-ef7b53a1178f service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.0888832 Sep 03 11:34:13.878602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1b9404-8037-454c-b1d9-4ca05133cd06 req-fadc9d3f-0a84-43d8-9138-002f81724170 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.880276 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c1b9404-8037-454c-b1d9-4ca05133cd06 req-fadc9d3f-0a84-43d8-9138-002f81724170 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0508049 Sep 03 11:34:13.885986 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-6421b461-1f24-4ac4-8bae-e1283fbf5514 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 1001 time: 0.0607827 Sep 03 11:34:13.920545 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c1b9404-8037-454c-b1d9-4ca05133cd06 req-171500bf-7a36-41e4-9eeb-087da7f6e3b4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338552 Sep 03 11:34:13.942801 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-2fcbe75e-78e2-428c-8c37-25517999e7af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.944286 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-2fcbe75e-78e2-428c-8c37-25517999e7af service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0493729 Sep 03 11:34:13.992729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-e53245ef-5c7e-4070-89c0-3723e06f8595 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:13.994321 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-e53245ef-5c7e-4070-89c0-3723e06f8595 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0407209 Sep 03 11:34:14.088205 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-0643c7ed-225d-4a19-8aa0-17a66c4e1eb7 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836344 Sep 03 11:34:14.139338 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1ec235e2-d042-4026-bdc2-da77b096452b no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:14.160740 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 1ec235e2-d042-4026-bdc2-da77b096452b {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:14.161077 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1ec235e2-d042-4026-bdc2-da77b096452b not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:14.201749 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-a7031f1c-dbde-4497-bb6b-01d1a4fcbdde req-75d26d09-483a-45da-bad6-9aae64158780 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967703 Sep 03 11:34:14.432607 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fe4b37-6c12-4b0d-8b85-4002cc82e5ca req-4d386868-8f4f-44a4-9c9b-2643ecf0bf70 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:14.434101 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25fe4b37-6c12-4b0d-8b85-4002cc82e5ca req-4d386868-8f4f-44a4-9c9b-2643ecf0bf70 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0519221 Sep 03 11:34:14.473779 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25fe4b37-6c12-4b0d-8b85-4002cc82e5ca req-ef10d6aa-ff13-49c0-8202-c723d422018b tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337398 Sep 03 11:34:14.877751 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-a9ce8c27-b856-4956-8661-71968c3276bd tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:14.879802 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-a9ce8c27-b856-4956-8661-71968c3276bd tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0469160 Sep 03 11:34:14.979646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Deleting port 762cbd9c-2049-467b-9943-50cbaeca9799 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:14.979994 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:15.042563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe3b04c-d57b-4c1f-ba4e-959ad2cf2659 req-55874e44-28f5-4ec3-9f90-e78bb98ae223 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:15.044088 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2fe3b04c-d57b-4c1f-ba4e-959ad2cf2659 req-55874e44-28f5-4ec3-9f90-e78bb98ae223 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 946 time: 0.0507054 Sep 03 11:34:15.078529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] For port 762cbd9c-2049-467b-9943-50cbaeca9799, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=762cbd9c-2049-467b-9943-50cbaeca9799,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:15.078890 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:15.095417 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2fe3b04c-d57b-4c1f-ba4e-959ad2cf2659 req-0847446e-3514-4872-85be-84d33997be22 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=726fd293-a4b6-41bd-86f0-08e2e13f4a9f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348620 Sep 03 11:34:15.361468 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:15.361736 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:15.362118 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Floating IP 3bb5d025-8935-423d-9482-8d36af0da92d disassociated. External IP: 172.27.0.120, port: 762cbd9c-2049-467b-9943-50cbaeca9799. Sep 03 11:34:15.363028 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Calling delete_port for 762cbd9c-2049-467b-9943-50cbaeca9799 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:15.536665 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:15.565998 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'Port': ['ID=762cbd9c-2049-467b-9943-50cbaeca9799,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:15.588311 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9c1c2a2-f271-467c-a396-82e0aeb24985 req-92e9109d-cac3-4200-af68-b2dc8ecd1450 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:15.589798 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9c1c2a2-f271-467c-a396-82e0aeb24985 req-92e9109d-cac3-4200-af68-b2dc8ecd1450 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0505691 Sep 03 11:34:15.648260 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9c1c2a2-f271-467c-a396-82e0aeb24985 req-74fd2d58-8153-40c2-b574-d181e437580f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522125 Sep 03 11:34:15.683081 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:16.002007 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:16.012594 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:16.023137 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:16.023845 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:33:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:16.041654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] No DVR routers for this DVR port 762cbd9c-2049-467b-9943-50cbaeca9799 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:16.044242 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:16.046410 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-2c070dc3-6599-4f86-b2e4-9f4e7432cda0 req-0a39fd38-c00f-4000-8b24-580cfb9c9c02 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "DELETE /v2.0/ports/762cbd9c-2049-467b-9943-50cbaeca9799 HTTP/1.1" status: 204 len: 173 time: 1.1588316 Sep 03 11:34:16.046926 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'name': 'network-vif-deleted', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:16.049139 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0838808f-3bbd-4c8e-8923-adaed482d394" -d '{"events": [{"server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "name": "network-vif-deleted", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:16.090359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1b12116-fee9-4a78-9256-3e998b3b4333 x-openstack-request-id: req-a1b12116-fee9-4a78-9256-3e998b3b4333 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:16.090745 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0", "name": "network-vif-deleted", "tag": "762cbd9c-2049-467b-9943-50cbaeca9799", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:16.091064 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a1b12116-fee9-4a78-9256-3e998b3b4333 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:16.091632 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0', 'name': 'network-vif-deleted', 'tag': '762cbd9c-2049-467b-9943-50cbaeca9799', 'status': 'completed', 'code': 200} Sep 03 11:34:16.143919 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:16.198671 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-19ebbdf2-a67a-45c3-9d6f-7d86f7c711e9 req-a6239b03-5219-4bd7-a346-e2a702ae2ecf tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=32a94f7b-bbb3-41f1-96ac-f4bbc18dd7e0 HTTP/1.1" status: 200 len: 210 time: 0.0315490 Sep 03 11:34:16.350140 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:16.380434 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:16.389374 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:16.389987 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:33:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:16.494621 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:16.711231 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:16.738655 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad20c7e8-2aa5-4183-82bf-c6265001ff9f None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:16.792493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86a91d5-f45a-4462-9efd-1f6df341765d req-b17a9055-192e-453f-8f1a-0505022f83ca tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:16.794774 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e86a91d5-f45a-4462-9efd-1f6df341765d req-b17a9055-192e-453f-8f1a-0505022f83ca tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0572169 Sep 03 11:34:16.836401 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e86a91d5-f45a-4462-9efd-1f6df341765d req-f4afb92e-ff1d-4b96-b3a1-c48915613d3f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352511 Sep 03 11:34:16.975930 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68d94c6b-3329-4d19-832b-5998eb72bf83 None None] New status for floating IP 3bb5d025-8935-423d-9482-8d36af0da92d: DOWN {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:34:17.364608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37122) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:17.421477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.446155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.536150 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.538882 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.540087 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "DELETE /v2.0/security-groups/726fd293-a4b6-41bd-86f0-08e2e13f4a9f HTTP/1.1" status: 204 len: 168 time: 0.1744151 Sep 03 11:34:17.543007 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37124) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:17.549301 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea39bf50-51d8-44ec-8396-5434ee28d77d tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=726fd293-a4b6-41bd-86f0-08e2e13f4a9f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:17.560310 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.api.v2.resource [None req-39412a80-65df-4d8f-9d92-0f1e2c0a69a4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] show failed (client error): The resource could not be found. Sep 03 11:34:17.561854 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-39412a80-65df-4d8f-9d92-0f1e2c0a69a4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups/726fd293-a4b6-41bd-86f0-08e2e13f4a9f HTTP/1.1" status: 404 len: 347 time: 0.0171010 Sep 03 11:34:17.565571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37126) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:17.694185 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Deleting port 4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:17.694589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.821710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.822035 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:17.841079 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Calling delete_port for 4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca owned by network:floatingip {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:17.860809 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f4d813-b836-4a43-890d-daf09fdd099d req-be6607f7-f7bb-440f-be1f-5629a1686736 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:17.862281 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-67f4d813-b836-4a43-890d-daf09fdd099d req-be6607f7-f7bb-440f-be1f-5629a1686736 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0792470 Sep 03 11:34:17.962835 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48f2db7-d5cb-427b-9c50-85f24457b18e req-654dac54-2afd-4fc6-83b9-fd0d9d0cb6a4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:17.966827 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c48f2db7-d5cb-427b-9c50-85f24457b18e req-654dac54-2afd-4fc6-83b9-fd0d9d0cb6a4 tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 945 time: 0.0583317 Sep 03 11:34:18.018974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c48f2db7-d5cb-427b-9c50-85f24457b18e req-07f541fb-92ca-45b5-81de-a3423a6f4f8f tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/security-groups?id=ec112d21-7995-406c-a4c6-878ef7f3c178&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483444 Sep 03 11:34:18.055304 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Deleting port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:18.055641 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.146630 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 762cbd9c-2049-467b-9943-50cbaeca9799 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:18.157721 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] For port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:18.158087 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.167974 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 762cbd9c-2049-467b-9943-50cbaeca9799 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:18.173495 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 762cbd9c-2049-467b-9943-50cbaeca9799 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:18.173633 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Calling delete_port for 8dba3504-1d0d-4e2a-9da3-d44f9f95684d owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:18.213569 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.249569 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'Port': ['ID=4da4ab75-4e47-494b-b2a1-fdf46c4ae7ca,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:18.324843 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.327348 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.328492 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-84233a37-2150-4805-af15-00923978c4e1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "DELETE /v2.0/floatingips/3bb5d025-8935-423d-9482-8d36af0da92d HTTP/1.1" status: 204 len: 168 time: 0.7610369 Sep 03 11:34:18.450888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.463705 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['8dba3504-1d0d-4e2a-9da3-d44f9f95684d'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:18.488112 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Pushing event deleted for resources: {'Port': ['ID=8dba3504-1d0d-4e2a-9da3-d44f9f95684d,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:18.534980 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] No DVR routers for this DVR port 8dba3504-1d0d-4e2a-9da3-d44f9f95684d on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:18.537536 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.539879 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-67f4d813-b836-4a43-890d-daf09fdd099d req-5edbca1d-8b54-48f9-bc92-b5269f5644cf tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.11 "DELETE /v2.0/ports/8dba3504-1d0d-4e2a-9da3-d44f9f95684d HTTP/1.1" status: 204 len: 173 time: 0.6345377 Sep 03 11:34:18.540430 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'name': 'network-vif-deleted', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:18.548567 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aadc1b60-b7f0-4bb3-be9f-84503054da20" -d '{"events": [{"server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "name": "network-vif-deleted", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:18.578844 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3eb397dd-c46c-4d07-94e4-85cae7a32128 x-openstack-request-id: req-3eb397dd-c46c-4d07-94e4-85cae7a32128 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:18.579197 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9daf21c4-4419-460c-8afc-45ab3abcdaaf", "name": "network-vif-deleted", "tag": "8dba3504-1d0d-4e2a-9da3-d44f9f95684d", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:18.579447 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-3eb397dd-c46c-4d07-94e4-85cae7a32128 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:18.579834 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9daf21c4-4419-460c-8afc-45ab3abcdaaf', 'name': 'network-vif-deleted', 'tag': '8dba3504-1d0d-4e2a-9da3-d44f9f95684d', 'status': 'completed', 'code': 200} Sep 03 11:34:18.816280 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37142) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:18.821455 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group': {'name': 'tempest-securitygroup--797166834', 'description': 'tempest-description--1015416586'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:18.907959 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:18.991199 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.056582 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.087823 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2eaca3b8-7478-4a79-8cfe-3b140a605352,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:19.130335 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9b0b0c59-707a-4c81-b98b-149c525c4e77 req-fbbd1a34-8e35-4b55-8128-e61b8f32ae7e tempest-ServerRescueNegativeTestJSON-585305857 tempest-ServerRescueNegativeTestJSON-585305857-project] 10.222.0.16 "GET /v2.0/ports?device_id=9daf21c4-4419-460c-8afc-45ab3abcdaaf HTTP/1.1" status: 200 len: 210 time: 0.0260594 Sep 03 11:34:19.136466 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.153931 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37154) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:19.154050 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-35be59f8-ee2f-42bb-a81b-5661c8860d5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.3231347 Sep 03 11:34:19.155650 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group_rule': {'security_group_id': '2eaca3b8-7478-4a79-8cfe-3b140a605352', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:19.256538 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.313500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.370903 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.387279 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8a22e20f-70e7-4ebf-8c11-d70168665959,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:19.462396 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.463738 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-abdd6f51-eb47-41e4-9dfb-4abab324f41e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3202085 Sep 03 11:34:19.466303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37162) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:19.470900 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'security_group_rule': {'security_group_id': '2eaca3b8-7478-4a79-8cfe-3b140a605352', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:19.605786 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.673534 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.736645 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.756665 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8624c448-9092-4f2f-97f4-b6c0a5cc7f9b,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:19.831686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:19.833041 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a64a95f1-4a65-428c-b6fb-18d64724c1e2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3657808 Sep 03 11:34:19.836372 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37166) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:19.841290 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:19.943023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.071953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.193019 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37170) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:20.198245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Allocated IP 172.27.0.99 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/7d7446c3-754c-4c53-bde0-b23209b3ea0f) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:20.295246 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.382926 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.419544 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:20.422245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:20.426528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:20.434548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=7d7446c3-754c-4c53-bde0-b23209b3ea0f,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:20.517359 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.605137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.617162 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.760474 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.814625 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.882355 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=7d7446c3-754c-4c53-bde0-b23209b3ea0f,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:20.892230 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.922951 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Deleting port 543b2a9c-76dc-46d9-9c41-9b1560b4608c {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:20.923299 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.984972 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:20.986548 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b44d6ea2-98c0-402c-9368-2166575b9f77 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1491120 Sep 03 11:34:21.006853 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] For port 543b2a9c-76dc-46d9-9c41-9b1560b4608c, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=543b2a9c-76dc-46d9-9c41-9b1560b4608c,segment=NetworkSegment(56638015-f78b-4c41-bcc1-ec6d8ef4f101),segment_id=56638015-f78b-4c41-bcc1-ec6d8ef4f101)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:21.007220 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.020546 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Calling delete_port for 543b2a9c-76dc-46d9-9c41-9b1560b4608c owned by network:router_interface {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:21.073398 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37184) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:21.204736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-275a1716-f773-4117-937b-61f7ff841899 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.218776 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-0b06f853-4b5c-40f9-9d26-dd572949a11e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--797166834&fields=id&tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 267 time: 0.0619614 Sep 03 11:34:21.255421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.286975 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=543b2a9c-76dc-46d9-9c41-9b1560b4608c,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:21.354192 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-3c07d375-74a6-4e89-8b25-f010c80c3b36 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:21.355694 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-3c07d375-74a6-4e89-8b25-f010c80c3b36 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 809 time: 0.1298172 Sep 03 11:34:21.377650 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-9168aac5-809e-43cc-b317-367198332751 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/quotas/8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 375 time: 0.0152924 Sep 03 11:34:21.435103 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-275a1716-f773-4117-937b-61f7ff841899 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.440422 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.456142 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-29cc7b1e-9c56-4cbe-b1d9-e088c11c2ccc tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0669849 Sep 03 11:34:21.486714 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-275a1716-f773-4117-937b-61f7ff841899 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.557709 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-275a1716-f773-4117-937b-61f7ff841899 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=0728f36c4c404719a59e35fdd3283651&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4830558 Sep 03 11:34:21.560509 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37198) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:21.570747 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-275a1716-f773-4117-937b-61f7ff841899 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b599c854-c97c-494e-b3b8-a7f79557353c,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:21.622084 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-722cb735-6264-47a8-9dd5-6d6346c746fc service neutron] 10.222.0.16 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1541829 Sep 03 11:34:21.650702 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.652571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:21.704827 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.760816 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-18ab6a41-d97b-4456-b4f2-a1667d304af6 service neutron] 10.222.0.16 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295350 Sep 03 11:34:21.766635 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:21.776532 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-92f8b3fa-4c36-4240-a89e-bf31f5f532c8 admin admin] 10.222.0.16 "PUT /v2.0/routers/dfe58ee8-bef9-4270-ba83-cf583ac6d5dc/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5775766 Sep 03 11:34:21.776532 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37200) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:21.778590 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Sync routers for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:21.788465 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:21.789384 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:33:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:21.856388 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.858976 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:21.862554 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/b599c854-c97c-494e-b3b8-a7f79557353c HTTP/1.1" status: 204 len: 168 time: 0.2985568 Sep 03 11:34:21.870349 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8312bbd1-b35b-4d68-8b3c-5352f6f7590f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b599c854-c97c-494e-b3b8-a7f79557353c,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:21.897540 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:21.901057 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.015471 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.049254 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef44ece0-70e6-401c-9d86-e570ffb9e1ab req-6bcacac4-4799-48d4-b22c-98c774966ad8 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 210 time: 0.0312352 Sep 03 11:34:22.107812 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90'}], 'enable_snat': True}, 'gw_port_id': '472048d9-0404-466a-aee8-6fe033180afb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:34:21Z', 'revision_number': 5, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port': {'id': '472048d9-0404-466a-aee8-6fe033180afb', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:42:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 251, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.90', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:21Z', 'updated_at': '2021-09-03T11:31:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:22.133955 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Checking router: dfe58ee8-bef9-4270-ba83-cf583ac6d5dc for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:22.136327 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Deleting port 472048d9-0404-466a-aee8-6fe033180afb {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:22.136669 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.147760 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Routers {'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:22.147760 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:33:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:22.172376 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 8dba3504-1d0d-4e2a-9da3-d44f9f95684d no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:22.210001 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 8dba3504-1d0d-4e2a-9da3-d44f9f95684d {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:22.210595 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 8dba3504-1d0d-4e2a-9da3-d44f9f95684d not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:22.228914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] For port 472048d9-0404-466a-aee8-6fe033180afb, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=472048d9-0404-466a-aee8-6fe033180afb,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:22.229583 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.244620 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Calling delete_port for 472048d9-0404-466a-aee8-6fe033180afb owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:22.354068 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] Set router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:22.410704 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:34:22Z', 'revision_number': 6, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:22.441004 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6957d3fb-27c6-4aac-bfea-73bf4a0e7c3d None None] The sync data for ids ['dfe58ee8-bef9-4270-ba83-cf583ac6d5dc'] in dv-cinder-760199-12-iscsi is: [{'id': 'dfe58ee8-bef9-4270-ba83-cf583ac6d5dc', 'name': 'tempest-ServerRescueNegativeTestJSON-206874543-router', 'tenant_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:20Z', 'updated_at': '2021-09-03T11:34:22Z', 'revision_number': 6, 'project_id': 'c3b2e7b58ddb4de5bf42ff1786108e9a', 'gw_port_host': None}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:22.574735 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37216) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:22.588280 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-63b58079-5e03-4094-82ba-1bb1c522e19a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.679816 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-63b58079-5e03-4094-82ba-1bb1c522e19a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.723556 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.750081 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Pushing event deleted for resources: {'Port': ['ID=472048d9-0404-466a-aee8-6fe033180afb,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:22.769059 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-63b58079-5e03-4094-82ba-1bb1c522e19a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.808572 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-63b58079-5e03-4094-82ba-1bb1c522e19a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ebd0fe1157784da2a5a8e7ae3bc2da51&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2327497 Sep 03 11:34:22.809414 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b58079-5e03-4094-82ba-1bb1c522e19a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a23a44d3-7945-4d97-a7aa-40a5727c6d01,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:22.811797 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37218) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:22.822121 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.886031 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.919008 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.944563 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:22.946764 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.072163 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.074038 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.075267 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/a23a44d3-7945-4d97-a7aa-40a5727c6d01 HTTP/1.1" status: 204 len: 168 time: 0.2625279 Sep 03 11:34:23.083478 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf927c09-d159-4a49-8b53-c2791fec6545 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a23a44d3-7945-4d97-a7aa-40a5727c6d01,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:23.117333 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.117874 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dfe58ee8-bef9-4270-ba83-cf583ac6d5dc {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:34:23.123532 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.128452 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-657af1ad-edc5-4815-8c33-62b008edd938 admin admin] 10.222.0.16 "DELETE /v2.0/routers/dfe58ee8-bef9-4270-ba83-cf583ac6d5dc HTTP/1.1" status: 204 len: 168 time: 1.3491812 Sep 03 11:34:23.128654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37226) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:23.154925 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5194872-5ab9-496f-acbf-ec6ccfa2baa8 req-36307144-4011-429f-ad17-1e6386508163 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 210 time: 0.0347049 Sep 03 11:34:23.188264 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Deleting subnet 2d8dac57-65e4-4460-baea-bbf51d76bcf1 {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:34:23.191679 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.237870 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.290221 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.298299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 543b2a9c-76dc-46d9-9c41-9b1560b4608c no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:23.321460 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 543b2a9c-76dc-46d9-9c41-9b1560b4608c {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:23.321803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 543b2a9c-76dc-46d9-9c41-9b1560b4608c not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:23.405480 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.440637 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d8dac57-65e4-4460-baea-bbf51d76bcf1,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:23.447382 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.449427 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-7a181bf5-916c-4147-b046-2fd8b3ae077c admin admin] 10.222.0.16 "DELETE /v2.0/subnets/2d8dac57-65e4-4460-baea-bbf51d76bcf1 HTTP/1.1" status: 204 len: 168 time: 0.3196263 Sep 03 11:34:23.452810 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37230) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:23.526145 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.611109 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.621101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29b4f20f-4a29-4a98-9a98-c60b1b87931c']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:23.630841 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56638015-f78b-4c41-bcc1-ec6d8ef4f101') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:23.634343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56638015-f78b-4c41-bcc1-ec6d8ef4f101') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:23.639750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.653386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.659114 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Releasing vlan 363 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:34:23.659494 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:34:23.661829 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:34:23.725046 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-013dc617-e295-4218-8afb-c987eb662ee2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.793642 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.799077 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.806496 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] 10.222.0.16 "DELETE /v2.0/networks/29b4f20f-4a29-4a98-9a98-c60b1b87931c HTTP/1.1" status: 204 len: 168 time: 0.3470726 Sep 03 11:34:23.811261 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b25fa7-1330-4fa6-9b66-1510cc7bf7f4 admin admin] Pushing event deleted for resources: {'Network': ['ID=29b4f20f-4a29-4a98-9a98-c60b1b87931c,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:23.893563 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37234) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:23.904896 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-98a80d65-4d03-4f01-a1ff-f5eed26b6e48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:23.991947 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-98a80d65-4d03-4f01-a1ff-f5eed26b6e48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.114415 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-98a80d65-4d03-4f01-a1ff-f5eed26b6e48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.118735 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-cb00e39d-598e-4e6e-b85c-ac2e205e1a15 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:24.120345 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-cb00e39d-598e-4e6e-b85c-ac2e205e1a15 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 809 time: 0.1056805 Sep 03 11:34:24.156058 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-98a80d65-4d03-4f01-a1ff-f5eed26b6e48 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=076f1011d26446b78fe65fdcf8491446&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2612650 Sep 03 11:34:24.156058 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a80d65-4d03-4f01-a1ff-f5eed26b6e48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=370a1eb5-f275-4e1a-8306-5c2b779f84df,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:24.156732 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37236) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:24.170913 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-55baa828-6224-4ffd-8d6a-1e18de1af5bd tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc HTTP/1.1" status: 200 len: 379 time: 0.0400422 Sep 03 11:34:24.182094 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'port': {'device_id': '8f10c833-a794-4338-8166-b83ab4e5a998', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'admin_state_up': True, 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'security_groups': ['2eaca3b8-7478-4a79-8cfe-3b140a605352']}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:24.198649 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37240) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:24.221055 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.259200 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.279309 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a105322f-391b-4ead-8dcf-9effc306aa29 req-505c6596-205d-4cad-99b9-6e012f00eaa4 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 210 time: 0.0413032 Sep 03 11:34:24.308574 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-73581cf6-459b-4bcd-9800-54b2b2417200 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c3b2e7b58ddb4de5bf42ff1786108e9a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1086321 Sep 03 11:34:24.311358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37242) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:24.387335 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.393552 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.396828 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.398020 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/370a1eb5-f275-4e1a-8306-5c2b779f84df HTTP/1.1" status: 204 len: 168 time: 0.2403185 Sep 03 11:34:24.407782 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99bd9980-48a4-4e14-81f1-571e65f87aa8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=370a1eb5-f275-4e1a-8306-5c2b779f84df,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:24.411770 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.445375 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Made reservation on behalf of 8e0bcf21f2dd49fe9f29d6892da5d5cc for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:24.448875 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.570587 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.573092 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.574320 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/ec112d21-7995-406c-a4c6-878ef7f3c178 HTTP/1.1" status: 204 len: 168 time: 0.2620730 Sep 03 11:34:24.591636 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99d07ffe-cf5d-4ef5-b070-28b941f6f801 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec112d21-7995-406c-a4c6-878ef7f3c178,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:24.594697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Allocated IP 172.20.0.6 (246bd34f-94aa-4eae-85ba-a0f3e2f663ce/d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a/f6ef2462-ac65-4a02-bbea-e6ca11e791b8) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:24.737726 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.751908 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Transition to ACTIVE for port object f6ef2462-ac65-4a02-bbea-e6ca11e791b8 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:24.828878 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 472048d9-0404-466a-aee8-6fe033180afb no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:24.848867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:24.864629 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 472048d9-0404-466a-aee8-6fe033180afb {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:24.865102 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 472048d9-0404-466a-aee8-6fe033180afb not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:24.896549 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:24.899899 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:24.903611 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:24.943943 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event updated for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:24.968996 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:24.969876 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.074543 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-84f8b2f5-02b8-4eb5-accd-a42cfc93a3a0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8973539 Sep 03 11:34:25.089473 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Request body: {'port': {'device_id': '8f10c833-a794-4338-8166-b83ab4e5a998', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:25.155702 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.233671 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-bf4b6049-6d6d-4aef-865c-9ab8ed711989 None None] Provisioning for port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:25.237508 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-bf4b6049-6d6d-4aef-865c-9ab8ed711989 None None] Provisioning complete for port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:25.237905 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-bf4b6049-6d6d-4aef-865c-9ab8ed711989 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.274299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-bf4b6049-6d6d-4aef-865c-9ab8ed711989 None None] Port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:25.432631 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79954529-ec91-42a0-9769-46d37ece37c1 req-4ca25100-b274-4014-98f6-1d2960c85dc3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:25.435243 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79954529-ec91-42a0-9769-46d37ece37c1 req-4ca25100-b274-4014-98f6-1d2960c85dc3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 931 time: 0.0762467 Sep 03 11:34:25.440919 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6ef2462-ac65-4a02-bbea-e6ca11e791b8 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:34:25.450597 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.468032 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Transition to ACTIVE for port object f6ef2462-ac65-4a02-bbea-e6ca11e791b8 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:25.481176 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79954529-ec91-42a0-9769-46d37ece37c1 req-38ebfbdd-4d9d-41f8-9182-bd84a58b2982 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391624 Sep 03 11:34:25.559484 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.615042 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Pushing event updated for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:25.702265 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Attempting to bind port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:25.702595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Attempting to bind port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:25.702933 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Attempting to bind port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:25.708661 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:34:25.709087 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Attempting to bind port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 on network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:25.714748 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:25.715088 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Checking segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:25.715473 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Bound using segment: {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:25.716004 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Bound port: f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '177d43b1-95c4-4139-b1c2-29cb385a65be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:25.716267 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.750517 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37294) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:25.803218 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:25.806355 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:25.864556 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-network', 'tenant_id': '306eebd846b1470cbf044b5d93c25528'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:25.868668 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.906967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:25.907612 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.909009 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] 10.222.0.11 "PUT /v2.0/ports/f6ef2462-ac65-4a02-bbea-e6ca11e791b8 HTTP/1.1" status: 200 len: 1093 time: 0.8253348 Sep 03 11:34:25.909537 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:25.913011 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea4ebd74-d70b-4a85-9367-cec10642b29a" -d '{"events": [{"name": "network-changed", "server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:25.946550 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6841f8e5-97f1-4bf6-937c-f948790fd81f service neutron] Pushing event updated for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:25.951707 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7d0ba3b-f2eb-425c-91cc-9d84284c1e29 x-openstack-request-id: req-c7d0ba3b-f2eb-425c-91cc-9d84284c1e29 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:25.952113 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:25.952523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c7d0ba3b-f2eb-425c-91cc-9d84284c1e29 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:25.952960 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'status': 'completed', 'code': 200} Sep 03 11:34:25.968492 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Made reservation on behalf of 306eebd846b1470cbf044b5d93c25528 for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:25.970801 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:25.980622 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.023811 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-17a73a9b-6b7e-4f8d-8792-9da5b398cf3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.025411 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-17a73a9b-6b7e-4f8d-8792-9da5b398cf3b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 1096 time: 0.0515606 Sep 03 11:34:26.079859 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.129065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-5cfdf5ee-9ab8-4797-9e56-e78b2b9e4663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.130581 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-5cfdf5ee-9ab8-4797-9e56-e78b2b9e4663 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0963862 Sep 03 11:34:26.165182 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.196997 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] vlan segment allocate from pool success with {'vlan_id': 360, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:34:26.207532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2bd33d76-25f7-40b7-8f22-995bae30401a,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:26.214435 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.215149 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Added segment b06e758a-f9ce-4d63-bba0-644a9ca2bd2d of type vlan for network f307cfd8-e7a3-4489-9872-541459138ccc Sep 03 11:34:26.245583 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-9069a559-bad8-4ce1-998a-916a82ab790f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.247261 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ea4ebd74-d70b-4a85-9367-cec10642b29a req-9069a559-bad8-4ce1-998a-916a82ab790f service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1061506 Sep 03 11:34:26.258961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.313638 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d8d26ff3-7ae1-4c0c-a521-353fa7e71a36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.327706 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-43fdeed2-715e-4b01-9e70-58fb22b48ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.329225 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-43fdeed2-715e-4b01-9e70-58fb22b48ae4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 1096 time: 0.0428917 Sep 03 11:34:26.341865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.342912 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.343495 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.371756 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-6bdf97c1-2459-4bc1-aeeb-07c1799dabb8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8 HTTP/1.1" status: 200 len: 217 time: 0.0338547 Sep 03 11:34:26.401229 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] Pushing event updated for resources: {'Network': ['ID=f307cfd8-e7a3-4489-9872-541459138ccc,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:26.415518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network f307cfd8-e7a3-4489-9872-541459138ccc details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:34:26.423321 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-477be9a3-be79-460c-a685-023609edf381 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.6715794 Sep 03 11:34:26.427406 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37302) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:26.432353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Request body: {'subnet': {'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-subnet', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:26.434120 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-2df8c99c-dc38-4b95-8931-c350a8ebdb20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.435864 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-2df8c99c-dc38-4b95-8931-c350a8ebdb20 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0567970 Sep 03 11:34:26.481587 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-f134a129-6b62-4a29-8cd1-4dcf9a3c920c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.483046 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-f134a129-6b62-4a29-8cd1-4dcf9a3c920c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0397174 Sep 03 11:34:26.512037 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Made reservation on behalf of 306eebd846b1470cbf044b5d93c25528 for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:26.514333 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.612435 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-94ad1a5a-fb9f-4e3d-ae21-aebab8be2ecc service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218519 Sep 03 11:34:26.646360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ac500f-1e73-4d66-8f66-54201006e5e5 req-9ef33246-d9e3-4680-9cda-80d494fef447 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:26.647881 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a6ac500f-1e73-4d66-8f66-54201006e5e5 req-9ef33246-d9e3-4680-9cda-80d494fef447 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 943 time: 0.0683410 Sep 03 11:34:26.708296 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.715317 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b815e7ef-ebc5-4230-9f6b-5cafba84e840 req-7304fe55-155c-45d9-9525-053445554aae service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938387 Sep 03 11:34:26.721852 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a6ac500f-1e73-4d66-8f66-54201006e5e5 req-06d87df9-4bf1-4272-a78b-812f67be4ba5 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666494 Sep 03 11:34:26.867977 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:26.924828 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6a03475a-6598-4871-b0ad-65ad1f51a945,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:26.932708 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Checking segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:26.933057 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Network hostable DHCP agents. Network: f307cfd8-e7a3-4489-9872-541459138ccc, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:34:27.031252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Network f307cfd8-e7a3-4489-9872-541459138ccc is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:34:27.130286 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, f307cfd8-e7a3-4489-9872-541459138ccc) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:27.134247 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:27.134864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.139316 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6718e526-8c26-42f8-8e80-9b569407c9f4 None None] Network f307cfd8-e7a3-4489-9872-541459138ccc requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:27.240064 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f246b0fc-753c-4f04-becc-202b44475c90 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.8115366 Sep 03 11:34:27.242754 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37312) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:27.247200 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:27.282008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-f307cfd8-e7a3-4489-9872-541459138ccc', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:34:27.282821 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.365856 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.367272 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.420040 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Allocated IP 172.20.0.2 (f307cfd8-e7a3-4489-9872-541459138ccc/6a03475a-6598-4871-b0ad-65ad1f51a945/5863b223-5387-46f5-81b2-deaa6a9da9a8) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:27.437169 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.455673 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-1d7e5019-406d-4c2a-9d82-04e1577262ea tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-404849827&fields=id&tenant_id=a929f96c596b45e78449a64936959efe HTTP/1.1" status: 200 len: 267 time: 0.0718551 Sep 03 11:34:27.511738 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-eec2d0d5-b8d0-4932-980c-9e7345ac4132 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:27.513226 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-eec2d0d5-b8d0-4932-980c-9e7345ac4132 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 985 time: 0.0510945 Sep 03 11:34:27.548344 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Request body: {'port': {'security_groups': ['f132ebc1-0d3b-402f-888c-c905d3a1e882']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:27.581481 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.591065 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Transition to ACTIVE for port object 5863b223-5387-46f5-81b2-deaa6a9da9a8 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:27.607690 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Transition to ACTIVE for port object 5863b223-5387-46f5-81b2-deaa6a9da9a8 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:27.648947 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.709066 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.763074 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Network f307cfd8-e7a3-4489-9872-541459138ccc is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:27.769473 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:27.772020 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Pushing event updated for resources: {'Port': ['ID=5863b223-5387-46f5-81b2-deaa6a9da9a8,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:27.774481 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:27.782677 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.783044 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.783385 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.783716 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.784042 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.784366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.784688 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.785008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.786067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.786067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.786067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.786329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:27.839900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Attempting to bind port 5863b223-5387-46f5-81b2-deaa6a9da9a8 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:27.840262 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Attempting to bind port 5863b223-5387-46f5-81b2-deaa6a9da9a8 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:27.840612 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Attempting to bind port 5863b223-5387-46f5-81b2-deaa6a9da9a8 on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:27.845596 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:27.845967 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Checking segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:27.846399 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.846774 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Bound using segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:27.847231 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Bound port: 5863b223-5387-46f5-81b2-deaa6a9da9a8, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:27.847826 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.924095 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] For port 5863b223-5387-46f5-81b2-deaa6a9da9a8, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:27.927625 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] For port 5863b223-5387-46f5-81b2-deaa6a9da9a8, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5863b223-5387-46f5-81b2-deaa6a9da9a8,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:27.962916 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.977885 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:27.988019 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf4deae-b0da-4115-8412-ac72bb587968 req-e9e979ae-ef8e-41ed-8155-42257405542e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:27.990045 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-edf4deae-b0da-4115-8412-ac72bb587968 req-e9e979ae-ef8e-41ed-8155-42257405542e tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 943 time: 0.1736186 Sep 03 11:34:28.060858 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.062800 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-edf4deae-b0da-4115-8412-ac72bb587968 req-75cff4b1-f307-4d81-b51c-6378be2945c2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0664141 Sep 03 11:34:28.131667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b786341-e511-486c-a916-4dc3a9813225 None None] Pushing event updated for resources: {'Port': ['ID=5863b223-5387-46f5-81b2-deaa6a9da9a8,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:28.203581 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6ef2462-ac65-4a02-bbea-e6ca11e791b8 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:34:28.264464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:28.300431 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.314945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:28.340861 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'port_id': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'mac_address': 'fa:16:3e:ae:03:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:34:28.395165 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.396377 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.408528 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:28.416366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6ef2462-ac65-4a02-bbea-e6ca11e791b8 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:34:28.457776 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:28.458438 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.460337 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-02ba13c9-904d-4e8a-b62f-fb122581da29 req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "PUT /v2.0/ports/0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 943 time: 0.9182191 Sep 03 11:34:28.465571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:28.468050 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37330) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:28.469550 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd" -d '{"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:28.524051 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:28.539760 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38c537d4-360a-4b7e-b953-9b38e8694dbf x-openstack-request-id: req-38c537d4-360a-4b7e-b953-9b38e8694dbf {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:28.540360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:28.540360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-38c537d4-360a-4b7e-b953-9b38e8694dbf {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:28.540901 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:34:28.553309 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb128a05-98b5-47a7-9111-7de0f18c30d4 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event updated for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=7']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:28.571208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.575028 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:28.595778 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.599852 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.608695 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.620028 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-a0982396-ff27-4880-9cad-e37a3dfae45f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:28.621704 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-a0982396-ff27-4880-9cad-e37a3dfae45f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1099 time: 0.0665312 Sep 03 11:34:28.668400 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.733571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Allocated IP 172.27.0.39 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/ba14d297-7b54-41cc-8378-8d20234f1511) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:28.766044 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:28.820440 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-362ce277-167b-44b9-8a19-1813921edce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:28.821940 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-362ce277-167b-44b9-8a19-1813921edce8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.1910846 Sep 03 11:34:28.886641 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f6ef2462-ac65-4a02-bbea-e6ca11e791b8'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:28.900580 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:28.921990 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-45efb587-b900-46d2-bda0-7bb1ef13a403 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 1001 time: 0.0910223 Sep 03 11:34:28.975686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-ceacb9c0-9b3d-4153-ad90-47d39b2d28b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:28.981508 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-ceacb9c0-9b3d-4153-ad90-47d39b2d28b1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0482168 Sep 03 11:34:29.003099 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5863b223-5387-46f5-81b2-deaa6a9da9a8 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:29.013679 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.016380 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.020073 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "DELETE /v2.0/security-groups/6b3a8906-ea37-4516-8bdc-2bb514cd8ecf HTTP/1.1" status: 204 len: 168 time: 0.5476863 Sep 03 11:34:29.021071 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37340) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:29.038840 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f19c546-13c7-4988-a6c6-9c7b16ded3f9 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b3a8906-ea37-4516-8bdc-2bb514cd8ecf,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:29.049025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e366120e-381a-41cc-908c-de64fe38947b None None] Provisioning complete for port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:29.049509 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e366120e-381a-41cc-908c-de64fe38947b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.052118 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-03fb3a79-a587-49b6-8f68-52b8dc7afd7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:29.053920 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-03fb3a79-a587-49b6-8f68-52b8dc7afd7d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0666852 Sep 03 11:34:29.072462 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.135992 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:29.143899 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:29.199246 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:29.233732 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-406d5f9f-ad0c-497a-a57e-bc939082f45c service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1708539 Sep 03 11:34:29.260272 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Pushing event updated for resources: {'Port': ['ID=ba14d297-7b54-41cc-8378-8d20234f1511,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:29.279589 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.346290 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5481531a-2a64-43e3-bfc6-8e2e9843f527 req-21f48fb0-93ec-48e3-99eb-ecde67d2f624 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:29.348002 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5481531a-2a64-43e3-bfc6-8e2e9843f527 req-21f48fb0-93ec-48e3-99eb-ecde67d2f624 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 944 time: 0.1465542 Sep 03 11:34:29.350658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 5863b223-5387-46f5-81b2-deaa6a9da9a8 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:29.372801 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-6f3ac7b1-10a4-4c00-9a2c-a294c7ec24fd req-8ec756a1-c2d0-44e3-902a-93c1ca209925 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310551 Sep 03 11:34:29.397521 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4574a1a-df31-4e39-ba18-8d83439e2400 None None] Network f307cfd8-e7a3-4489-9872-541459138ccc requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:29.477217 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Deleting port 35676349-856e-44ec-bc48-2b37e9ac1640 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:29.477551 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.488422 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5481531a-2a64-43e3-bfc6-8e2e9843f527 req-4021af99-1b83-4f3a-ab94-3a6befc8ff68 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1078074 Sep 03 11:34:29.576848 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.577443 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.589631 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Calling delete_port for 35676349-856e-44ec-bc48-2b37e9ac1640 owned by network:floatingip {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:29.604805 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Provisioning for port 5863b223-5387-46f5-81b2-deaa6a9da9a8 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:29.608982 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Provisioning complete for port 5863b223-5387-46f5-81b2-deaa6a9da9a8 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:29.609359 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.809750 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.833176 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:29.847385 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] For port 5863b223-5387-46f5-81b2-deaa6a9da9a8, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5863b223-5387-46f5-81b2-deaa6a9da9a8,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:29.965226 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.012263 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d196c84-4bc3-4abb-9bd6-6477c7bac4a5 None None] Pushing event updated for resources: {'Port': ['ID=5863b223-5387-46f5-81b2-deaa6a9da9a8,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:30.095060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-49f3353f-49d3-493b-918b-f87bad0ab969 None None] Provisioning complete for port 5863b223-5387-46f5-81b2-deaa6a9da9a8 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:30.095741 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-49f3353f-49d3-493b-918b-f87bad0ab969 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.218445 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6ef2462-ac65-4a02-bbea-e6ca11e791b8 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:30.266752 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.297366 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event deleted for resources: {'Port': ['ID=35676349-856e-44ec-bc48-2b37e9ac1640,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:30.330601 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:30.334595 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:30.334984 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.375488 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.379089 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks [] for floatingip, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.379478 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Floating IP d04e2da6-37d3-468d-85ee-16828e6c6a21 disassociated (deleted). External IP: 172.27.0.65, port: 0c1a0140-6eb6-4bae-ba93-b742e42fed8e. Sep 03 11:34:30.425026 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.450704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:30.453180 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fe9298b-8dc4-4589-aac2-e13cf371255f" -d '{"events": [{"server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "name": "network-vif-plugged", "status": "completed", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:30.467599 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:30.490816 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b409cd2-99ff-4122-aff7-7ce90d1e699b x-openstack-request-id: req-7b409cd2-99ff-4122-aff7-7ce90d1e699b {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:30.491109 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "name": "network-vif-plugged", "status": "completed", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:30.491360 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7b409cd2-99ff-4122-aff7-7ce90d1e699b {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:30.491752 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'code': 200} Sep 03 11:34:30.530356 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.589101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:30.716244 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e3e1e8-6177-400f-884c-2647188963a5 req-c49a17cb-76ca-4895-8a33-2e4a31a06caa tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:30.717790 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-53e3e1e8-6177-400f-884c-2647188963a5 req-c49a17cb-76ca-4895-8a33-2e4a31a06caa tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.1511128 Sep 03 11:34:30.767951 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:30.775722 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-53e3e1e8-6177-400f-884c-2647188963a5 req-520e6c72-c57b-42a9-ae67-16723d553a1a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501235 Sep 03 11:34:30.799678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5339955-6f54-4986-afbe-b188a73d6b0d req-a34981ed-0387-4a09-a83b-a88a3703c5cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:30.801359 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d5339955-6f54-4986-afbe-b188a73d6b0d req-a34981ed-0387-4a09-a83b-a88a3703c5cd service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 1098 time: 0.0549679 Sep 03 11:34:30.819112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Router 1daa5492-64d1-4f5a-8048-785e794ae777 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94433) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:34:30.842619 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d5339955-6f54-4986-afbe-b188a73d6b0d req-bcec3625-f98f-4d91-8f8c-2aa9d1b57a1f service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336897 Sep 03 11:34:30.884559 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5863b223-5387-46f5-81b2-deaa6a9da9a8 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:30.931709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 5863b223-5387-46f5-81b2-deaa6a9da9a8 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:30.932162 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.959327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:30.964724 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:30.971220 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Sync routers for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:30.984225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:30.984843 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.003660 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-28d1a3b8-e472-4f5a-b552-ef103d9d3f62 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "DELETE /v2.0/floatingips/d04e2da6-37d3-468d-85ee-16828e6c6a21 HTTP/1.1" status: 204 len: 168 time: 1.9791412 Sep 03 11:34:31.003660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:31.006793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65265537-87d1-4ab6-9944-385caed7bf18" -d '{"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:31.014305 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:31.029532 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:31.042325 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:31.046599 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.072184 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0701674-bd9a-4ce1-a5aa-442845849b0b x-openstack-request-id: req-c0701674-bd9a-4ce1-a5aa-442845849b0b {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:31.072623 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:31.072941 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c0701674-bd9a-4ce1-a5aa-442845849b0b {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:31.073388 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:34:31.095245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:31.099355 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-34027541-e246-41d3-a87c-a06bb27262d4 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 3.8528631 Sep 03 11:34:31.100321 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37364) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:31.149388 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65265537-87d1-4ab6-9944-385caed7bf18 req-2a3caaa8-c1bc-4b7a-a599-a11c9aa40935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:31.151612 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-2a3caaa8-c1bc-4b7a-a599-a11c9aa40935 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a929f96c596b45e78449a64936959efe&device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 1099 time: 0.0554597 Sep 03 11:34:31.176801 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:31.205474 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:31.288355 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65265537-87d1-4ab6-9944-385caed7bf18 req-ae1a6874-d19c-4aaf-8401-98a1317a48f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:31.289852 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-ae1a6874-d19c-4aaf-8401-98a1317a48f3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 200 len: 915 time: 0.1305428 Sep 03 11:34:31.334999 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-4ae43980-d87c-4af8-a5c1-9d8060147411 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 200 len: 217 time: 0.0363226 Sep 03 11:34:31.399749 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65265537-87d1-4ab6-9944-385caed7bf18 req-34287b8c-3bfb-4409-9360-3a52ada27980 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:31.402561 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-34287b8c-3bfb-4409-9360-3a52ada27980 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 200 len: 853 time: 0.0597098 Sep 03 11:34:31.439894 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.483221 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65265537-87d1-4ab6-9944-385caed7bf18 req-5d676fc4-abf9-4512-b700-cfbb9c59ed93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:31.483221 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-5d676fc4-abf9-4512-b700-cfbb9c59ed93 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f39e51e6-3ab9-4955-9302-06484ab5c362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0705278 Sep 03 11:34:31.498067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Checking router: 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:31.507781 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:31.508399 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.520605 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:29Z', 'revision_number': 3, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.571554 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:31.577559 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Updating router 1daa5492-64d1-4f5a-8048-785e794ae777 port ba14d297-7b54-41cc-8378-8d20234f1511 binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:34:31.600384 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-2747a04b-e217-4d1e-9b05-a83b5f77cf99 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1087017 Sep 03 11:34:31.613607 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:31.656264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:31.666870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:31.727900 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-65265537-87d1-4ab6-9944-385caed7bf18 req-51b2e7dd-22eb-4942-a976-3294c8085676 service neutron] 10.222.0.11 "GET /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1149509 Sep 03 11:34:31.923442 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:31.924593 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:31.929186 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Allocated IP 172.20.0.1 (f307cfd8-e7a3-4489-9872-541459138ccc/6a03475a-6598-4871-b0ad-65ad1f51a945/283de847-2846-4c97-b399-25c7ab0a7b2b) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:31.934404 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Transition to ACTIVE for port object ba14d297-7b54-41cc-8378-8d20234f1511 will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:31.941689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e00b9b-0b8c-48ad-8356-d73c4d5e0d1f req-e8869ac9-aac7-4913-a6a2-99b7a13a8ce2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:31.944736 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25e00b9b-0b8c-48ad-8356-d73c4d5e0d1f req-e8869ac9-aac7-4913-a6a2-99b7a13a8ce2 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0841753 Sep 03 11:34:31.963129 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92bf4a71-a356-4ba7-b890-58935e3ed258 None None] The sync data for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi is: [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:43Z', 'revision_number': 4, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': 'a435a074-d9b4-4ecd-bff1-866eee3a6408', 'name': '', 'network_id': 'f39e51e6-3ab9-4955-9302-06484ab5c362', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'mac_address': 'fa:16:3e:25:1b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:42Z', 'updated_at': '2021-09-03T11:31:51Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'subnets': [{'id': 'fe371eea-dd00-405f-8801-d52a715cf14f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:32.005840 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.054115 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Pushing event updated for resources: {'Port': ['ID=ba14d297-7b54-41cc-8378-8d20234f1511,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:32.055952 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25e00b9b-0b8c-48ad-8356-d73c4d5e0d1f req-9ff5fbaf-c455-4cec-afe0-8287d76ec80c tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1012101 Sep 03 11:34:32.065596 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.066145 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.066863 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.067194 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.067672 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.068165 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.068659 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.069129 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.069617 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.070734 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.071224 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.071692 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:34:32.086630 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Attempting to bind port ba14d297-7b54-41cc-8378-8d20234f1511 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:32.087190 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Attempting to bind port ba14d297-7b54-41cc-8378-8d20234f1511 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:32.087694 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Attempting to bind port ba14d297-7b54-41cc-8378-8d20234f1511 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:32.093259 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.105241 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:32.105704 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:32.106165 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.106966 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:32.107710 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Bound port: ba14d297-7b54-41cc-8378-8d20234f1511, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:32.108427 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.109061 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Transition to ACTIVE for port object 283de847-2846-4c97-b399-25c7ab0a7b2b will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:32.181541 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] For port ba14d297-7b54-41cc-8378-8d20234f1511, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:32.182907 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] For port ba14d297-7b54-41cc-8378-8d20234f1511, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=ba14d297-7b54-41cc-8378-8d20234f1511,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:32.240455 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.266683 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.287035 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Network f307cfd8-e7a3-4489-9872-541459138ccc is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:32.290112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:32.293761 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:32.315417 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-113253d4-a91e-4d16-b8ce-cf7a06a4b00d None None] New status for floating IP d04e2da6-37d3-468d-85ee-16828e6c6a21: DOWN {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:34:32.329818 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Pushing event updated for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:32.341379 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:32.342015 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:32.357387 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.435197 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700f7f5e-e219-4a21-a017-cb06284ac180 None None] Pushing event updated for resources: {'Port': ['ID=ba14d297-7b54-41cc-8378-8d20234f1511,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:32.494580 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:32.579330 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.682764 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ebadcd18-e999-4a68-b4f7-07fa3e829583 None None] Provisioning for port 283de847-2846-4c97-b399-25c7ab0a7b2b completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:32.695059 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ebadcd18-e999-4a68-b4f7-07fa3e829583 None None] Provisioning complete for port 283de847-2846-4c97-b399-25c7ab0a7b2b triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:32.695059 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ebadcd18-e999-4a68-b4f7-07fa3e829583 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.701004 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:29Z', 'revision_number': 3, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:32.736466 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f7c19a7-e068-45c0-b9ab-50bb76b4eda5 None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:29Z', 'revision_number': 3, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:32.743588 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-ebadcd18-e999-4a68-b4f7-07fa3e829583 None None] Port 283de847-2846-4c97-b399-25c7ab0a7b2b cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:32.784434 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.873224 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.948341 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:32.955481 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Pushing event updated for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:33.083299 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Network f307cfd8-e7a3-4489-9872-541459138ccc is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:33.083299 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:33.293718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:33.323041 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c2c478-3138-4c02-b4d4-9a79f3153faa req-316fac5f-c8db-49b0-b893-db254af22716 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:33.324649 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9c2c478-3138-4c02-b4d4-9a79f3153faa req-316fac5f-c8db-49b0-b893-db254af22716 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0938182 Sep 03 11:34:33.373748 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-e0ac4312-b82f-41a1-8225-35ac473fd547 None None] Provisioning complete for port 283de847-2846-4c97-b399-25c7ab0a7b2b triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:33.374975 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e0ac4312-b82f-41a1-8225-35ac473fd547 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:33.417020 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-e0ac4312-b82f-41a1-8225-35ac473fd547 None None] Port 283de847-2846-4c97-b399-25c7ab0a7b2b cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:33.434081 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9c2c478-3138-4c02-b4d4-9a79f3153faa req-1a53070d-dfe6-490b-9341-787c559651df tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0722938 Sep 03 11:34:33.461417 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:33.476954 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-dc382adb-3d39-4e18-9fd7-37ac9f0570ac admin admin] 10.222.0.16 "PUT /v2.0/routers/1daa5492-64d1-4f5a-8048-785e794ae777/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3649247 Sep 03 11:34:33.599308 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ede3da-61b0-4c7c-b09c-67c4d8b45b28 req-4d8e27d6-b96c-4604-8c31-c246cee128e3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:33.600851 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33ede3da-61b0-4c7c-b09c-67c4d8b45b28 req-4d8e27d6-b96c-4604-8c31-c246cee128e3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0670762 Sep 03 11:34:33.610646 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37402) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:33.615221 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Request body: {'floatingip': {'port_id': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:33.670414 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.007884 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37412) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:34.014174 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1565422430', 'description': 'tempest-description--790696859'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:34.128878 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.225284 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.303486 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.337687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:34.344427 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.387640 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.388892 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8431637c-0a90-4c9d-8bc9-406f9f889fc5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.3798957 Sep 03 11:34:34.396823 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37416) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:34.401516 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group_rule': {'security_group_id': '6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:34.446029 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.448844 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:34.458193 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:34.461125 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:34.498113 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e03f038-9dd9-4635-91fa-c9d622af22da req-cb28ab2d-b13b-4af7-9ec4-c6181d642674 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:34.499623 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e03f038-9dd9-4635-91fa-c9d622af22da req-cb28ab2d-b13b-4af7-9ec4-c6181d642674 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0872092 Sep 03 11:34:34.512916 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.571818 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e03f038-9dd9-4635-91fa-c9d622af22da req-25efeeff-1c1d-4b60-b824-25df6b75a659 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471821 Sep 03 11:34:34.572079 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.575384 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:34.592589 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Floating IP a414cb49-435b-44a7-8439-e9ce5a4062ea associated. External IP: 172.27.0.99, port: f6ef2462-ac65-4a02-bbea-e6ca11e791b8. Sep 03 11:34:34.645052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.670663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9e04ba77-77b0-432d-a7dd-44c15a456728,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:34.753772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.757625 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1664aeb3-3d41-4537-b3f1-116797191862 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3589869 Sep 03 11:34:34.759602 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37422) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:34.767890 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group_rule': {'security_group_id': '6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:34.823052 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:34.878812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.906778 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 2, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:34.932029 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device ba14d297-7b54-41cc-8378-8d20234f1511 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:34.947372 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:34.951772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.953074 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.961900 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:34.962249 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Updating router 1daa5492-64d1-4f5a-8048-785e794ae777 port 283de847-2846-4c97-b399-25c7ab0a7b2b binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:34:34.975815 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:34.987909 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ae050f91-9d6c-44a0-8136-ee2ad9190574 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "PUT /v2.0/floatingips/a414cb49-435b-44a7-8439-e9ce5a4062ea HTTP/1.1" status: 200 len: 990 time: 1.3762095 Sep 03 11:34:34.988790 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:34.990669 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:34.991595 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-089d261b-7cfb-4df4-81da-49b072cafa21" -d '{"events": [{"name": "network-changed", "server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:35.013408 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:35.014047 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:35.029025 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.057208 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=60359eb8-2c5f-4e2a-926d-de32beb4b3c1,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:35.058659 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9736d23d-6f6d-432f-87fa-e676a6ee9abd x-openstack-request-id: req-9736d23d-6f6d-432f-87fa-e676a6ee9abd {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:35.058960 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:35.059208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-9736d23d-6f6d-432f-87fa-e676a6ee9abd {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:35.060950 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'status': 'completed', 'code': 200} Sep 03 11:34:35.132144 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-07ec476a-6860-4ead-bbfe-981a59fcb219 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:35.133658 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-07ec476a-6860-4ead-bbfe-981a59fcb219 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 1098 time: 0.0496712 Sep 03 11:34:35.136141 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.138689 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-02f005c6-caa1-4710-ae9f-33a7fa25fd00 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3759284 Sep 03 11:34:35.140680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37428) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:35.146176 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:35.250642 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.282838 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-0cc142e2-1e9c-4291-9463-46dc66db02f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:35.289431 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-0cc142e2-1e9c-4291-9463-46dc66db02f9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.1386688 Sep 03 11:34:35.329831 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:35.334567 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.357371 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Transition to ACTIVE for port object 283de847-2846-4c97-b399-25c7ab0a7b2b will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:35.369762 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port ba14d297-7b54-41cc-8378-8d20234f1511 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:35.375899 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.378201 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port ba14d297-7b54-41cc-8378-8d20234f1511 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:35.378793 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.380640 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-42d3a9c9-1122-421f-a8b9-51fbb693fe6c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8 HTTP/1.1" status: 200 len: 998 time: 0.0815883 Sep 03 11:34:35.433710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-4dad634d-acd2-4098-a2e8-413e02120579 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:35.435314 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-4dad634d-acd2-4098-a2e8-413e02120579 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0469680 Sep 03 11:34:35.467449 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.492108 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-4c113612-c148-410b-b92d-2500059d29cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:35.493745 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-4c113612-c148-410b-b92d-2500059d29cb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0497692 Sep 03 11:34:35.516219 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Allocated IP 172.27.0.126 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/739df9bf-605f-429d-9edd-1b2eb50bed37) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:35.520706 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45fd8b56-9b14-4bb8-8bb2-fbd94e469556 None None] Pushing event updated for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:35.597715 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Attempting to bind port 283de847-2846-4c97-b399-25c7ab0a7b2b on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:35.598474 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Attempting to bind port 283de847-2846-4c97-b399-25c7ab0a7b2b by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:35.599330 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Attempting to bind port 283de847-2846-4c97-b399-25c7ab0a7b2b on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:35.608225 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:35.608597 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Checking segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:35.610477 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.610879 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Bound using segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:35.612352 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Bound port: 283de847-2846-4c97-b399-25c7ab0a7b2b, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:35.613284 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.625689 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.669187 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-23b6be5c-e8f0-4f8f-8d05-77f8e04583de service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1651063 Sep 03 11:34:35.699746 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.716500 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port ba14d297-7b54-41cc-8378-8d20234f1511, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=ba14d297-7b54-41cc-8378-8d20234f1511,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:35.724912 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] For port 283de847-2846-4c97-b399-25c7ab0a7b2b, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:35.729209 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] For port 283de847-2846-4c97-b399-25c7ab0a7b2b, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=283de847-2846-4c97-b399-25c7ab0a7b2b,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:35.759772 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'a414cb49-435b-44a7-8439-e9ce5a4062ea', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.99', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 455, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:ae:03:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f10c833-a794-4338-8166-b83ab4e5a998', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:20Z', 'updated_at': '2021-09-03T11:34:34Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:35.778193 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0eec8d-0c6a-4b56-bd8f-7beabf812690 req-bf6bafbd-2236-4b25-8b6e-57ab0a5dc4b1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:35.779772 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f0eec8d-0c6a-4b56-bd8f-7beabf812690 req-bf6bafbd-2236-4b25-8b6e-57ab0a5dc4b1 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0695214 Sep 03 11:34:35.797872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:35.800772 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.805271 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.844213 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-089d261b-7cfb-4df4-81da-49b072cafa21 req-a6e6f054-6dbc-4103-aa87-a1fbebae8e72 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1655886 Sep 03 11:34:35.851450 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f0eec8d-0c6a-4b56-bd8f-7beabf812690 req-fa33b1c5-b3a4-43ac-b41e-e34bcebd87aa tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573945 Sep 03 11:34:35.865393 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:35.866102 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:35.883430 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:35.884256 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:35.886547 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=ba14d297-7b54-41cc-8378-8d20234f1511,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:35.948387 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:35.957714 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45fd8b56-9b14-4bb8-8bb2-fbd94e469556 None None] Pushing event updated for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=4']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:35.992423 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:35.995181 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:35.998733 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:36.003477 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:36.013759 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:36.095670 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=739df9bf-605f-429d-9edd-1b2eb50bed37,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:36.098995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.222565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.239390 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:36.265639 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d1925aa-a211-4f41-871c-22ac1371c7d6 None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:36.273464 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'a414cb49-435b-44a7-8439-e9ce5a4062ea', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.99', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 455, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:ae:03:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f10c833-a794-4338-8166-b83ab4e5a998', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:20Z', 'updated_at': '2021-09-03T11:34:34Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:36.336837 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f219ae93-3249-4786-99c4-a2f18bb78dc8 None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'a414cb49-435b-44a7-8439-e9ce5a4062ea', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'floating_ip_address': '172.27.0.99', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'port_id': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 455, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'mac_address': 'fa:16:3e:ae:03:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f10c833-a794-4338-8166-b83ab4e5a998', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:20Z', 'updated_at': '2021-09-03T11:34:34Z', 'revision_number': 1, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:36.416306 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.479486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.554030 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=739df9bf-605f-429d-9edd-1b2eb50bed37,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:36.569201 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.590034 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db768725-6f53-48e8-bc6a-3671a9225d74 None None] New status for floating IP a414cb49-435b-44a7-8439-e9ce5a4062ea: ACTIVE {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:34:36.644688 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:36.647611 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1c51af9c-2136-4baf-af20-258a33f6800a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5055358 Sep 03 11:34:36.799083 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-edf943f8-f900-4c75-a1e3-89509652a2fc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--1565422430&fields=id&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 267 time: 0.0388334 Sep 03 11:34:36.931429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-92746033-be4c-4f1b-8ee3-8810cf8ddb1b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:36.933079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-92746033-be4c-4f1b-8ee3-8810cf8ddb1b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 817 time: 0.1267378 Sep 03 11:34:36.954306 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0525565-9eb6-4574-85a8-63d5c7c7208a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/quotas/306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 375 time: 0.0148859 Sep 03 11:34:36.997100 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device ba14d297-7b54-41cc-8378-8d20234f1511 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:37.019517 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-0efade89-a683-40a2-bf63-34fa50cfa707 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0574663 Sep 03 11:34:37.053970 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port ba14d297-7b54-41cc-8378-8d20234f1511 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:37.054558 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:37.123331 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-700b9cb4-a81d-49a2-9381-465c256f2d70 service neutron] 10.222.0.16 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0947785 Sep 03 11:34:37.150025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 283de847-2846-4c97-b399-25c7ab0a7b2b up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:37.217527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-327cb088-d81e-4ea9-9b49-da8860cf7c90 service neutron] 10.222.0.16 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876613 Sep 03 11:34:37.267770 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 283de847-2846-4c97-b399-25c7ab0a7b2b completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:37.272972 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 283de847-2846-4c97-b399-25c7ab0a7b2b triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:37.273413 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:37.360705 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:37.405518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 283de847-2846-4c97-b399-25c7ab0a7b2b, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=283de847-2846-4c97-b399-25c7ab0a7b2b,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:37.462251 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:37.508905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f78191-7b2b-419d-8de8-65054194554e req-4426a928-b834-4b90-936a-92f1eba9a43d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:37.511042 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-38f78191-7b2b-419d-8de8-65054194554e req-4426a928-b834-4b90-936a-92f1eba9a43d tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0612743 Sep 03 11:34:37.518878 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:37.551907 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-38f78191-7b2b-419d-8de8-65054194554e req-de882b83-6575-4b6b-9693-59e51ba64ffa tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342805 Sep 03 11:34:37.615756 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3f7e92d0-5cb1-4fe4-a31b-204d1b912334 req-6ae2f151-a9f2-4841-b506-df01eeaf5870 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 210 time: 0.0258429 Sep 03 11:34:38.665170 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a763cf-b91d-4dd3-84ea-d4b3d01a8612 req-1d085b01-0e0c-4d2d-a75d-222d4acc7cbd tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:38.665170 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18a763cf-b91d-4dd3-84ea-d4b3d01a8612 req-1d085b01-0e0c-4d2d-a75d-222d4acc7cbd tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0486457 Sep 03 11:34:38.713807 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18a763cf-b91d-4dd3-84ea-d4b3d01a8612 req-e5aeb72f-1e9a-4704-823f-7753d322aac8 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/security-groups?id=f132ebc1-0d3b-402f-888c-c905d3a1e882&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427835 Sep 03 11:34:38.735891 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0eb86bb4-2e92-4ba9-9152-67c02a5b32ef req-ba5a5527-2947-431b-9514-f16cca3fce20 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 210 time: 0.0344260 Sep 03 11:34:38.784672 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-1cd3cc0e-18d8-4a69-9c33-b681fd971dc0 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:38.786058 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-1cd3cc0e-18d8-4a69-9c33-b681fd971dc0 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.11 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 946 time: 0.0490353 Sep 03 11:34:38.882724 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Deleting port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:38.883107 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:38.886137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 283de847-2846-4c97-b399-25c7ab0a7b2b up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:38.937936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 283de847-2846-4c97-b399-25c7ab0a7b2b triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:38.938523 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:38.977538 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] For port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:38.977910 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:38.991896 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Calling delete_port for 0c1a0140-6eb6-4bae-ba93-b742e42fed8e owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:39.181997 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:39.193996 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0c1a0140-6eb6-4bae-ba93-b742e42fed8e'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:39.212318 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Pushing event deleted for resources: {'Port': ['ID=0c1a0140-6eb6-4bae-ba93-b742e42fed8e,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:39.255019 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] No DVR routers for this DVR port 0c1a0140-6eb6-4bae-ba93-b742e42fed8e on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:39.257626 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:39.259660 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-ac260656-22b2-4a59-b63b-eab8abdd6a87 req-cbd45f24-73c5-455f-a1bd-193d09aa7f7e tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.11 "DELETE /v2.0/ports/0c1a0140-6eb6-4bae-ba93-b742e42fed8e HTTP/1.1" status: 204 len: 173 time: 0.4658289 Sep 03 11:34:39.260094 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'name': 'network-vif-deleted', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:39.262311 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e35a2d8-c89b-4fd9-b647-d897ca197d34" -d '{"events": [{"server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "name": "network-vif-deleted", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:39.296922 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01f43ccf-cf8f-454b-9f39-8c6d99c996fe x-openstack-request-id: req-01f43ccf-cf8f-454b-9f39-8c6d99c996fe {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:39.297225 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496f48b8-0710-41da-907b-a7938371e02d", "name": "network-vif-deleted", "tag": "0c1a0140-6eb6-4bae-ba93-b742e42fed8e", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:39.297458 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-01f43ccf-cf8f-454b-9f39-8c6d99c996fe {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:39.297844 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496f48b8-0710-41da-907b-a7938371e02d', 'name': 'network-vif-deleted', 'tag': '0c1a0140-6eb6-4bae-ba93-b742e42fed8e', 'status': 'completed', 'code': 200} Sep 03 11:34:39.855967 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61796b9d-a7e1-42cf-835c-d64d2d7f7bde req-407af7ba-d8e0-473b-a5de-706c0cd00609 tempest-TestMinimumBasicScenario-1799674427 tempest-TestMinimumBasicScenario-1799674427-project] 10.222.0.16 "GET /v2.0/ports?device_id=496f48b8-0710-41da-907b-a7938371e02d HTTP/1.1" status: 200 len: 210 time: 0.0518796 Sep 03 11:34:39.882458 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6530526c-c8c1-403b-93b0-867acb091b85 req-26bd25a1-02d2-48ce-afb0-93e7177ae890 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 210 time: 0.0553322 Sep 03 11:34:39.907752 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-52ccc1c8-6b03-41f8-9cf2-e106fd2eb9cc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:39.909293 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-52ccc1c8-6b03-41f8-9cf2-e106fd2eb9cc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 817 time: 0.3785346 Sep 03 11:34:39.953880 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-95fb6075-6d0d-4217-aad0-9d1f024f8ec8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 380 time: 0.0348446 Sep 03 11:34:39.964438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'port': {'device_id': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'admin_state_up': True, 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'security_groups': ['6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2']}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:40.225475 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Made reservation on behalf of 306eebd846b1470cbf044b5d93c25528 for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:40.229085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:40.352236 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Allocated IP 172.20.0.11 (f307cfd8-e7a3-4489-9872-541459138ccc/6a03475a-6598-4871-b0ad-65ad1f51a945/ea0c67e2-065e-475f-b1ce-c182f3c8ea81) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:40.496617 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:40.509854 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Transition to ACTIVE for port object ea0c67e2-065e-475f-b1ce-c182f3c8ea81 will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:40.609365 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:40.650671 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Network f307cfd8-e7a3-4489-9872-541459138ccc is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:40.653750 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:40.657339 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:40.690952 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:40.719123 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:40.720034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:40.782860 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-67bc4e23-bf50-481e-b604-88246af23cbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8228257 Sep 03 11:34:40.795040 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Request body: {'port': {'device_id': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:40.852334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.006102 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-442b379e-9315-4cfe-94d9-971259cc36a6 None None] Provisioning for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:41.015736 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-442b379e-9315-4cfe-94d9-971259cc36a6 None None] Provisioning complete for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:41.016324 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-442b379e-9315-4cfe-94d9-971259cc36a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.029477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c879bf0-90f5-4a67-8da7-e3cbfca5660b req-cdc06956-6933-4006-a95d-33bd79f296c6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:41.031521 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6c879bf0-90f5-4a67-8da7-e3cbfca5660b req-cdc06956-6933-4006-a95d-33bd79f296c6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 932 time: 0.0649505 Sep 03 11:34:41.059849 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-442b379e-9315-4cfe-94d9-971259cc36a6 None None] Port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:41.077716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6c879bf0-90f5-4a67-8da7-e3cbfca5660b req-8e243e6e-e976-471d-a4f4-ee442f46750c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395091 Sep 03 11:34:41.169068 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:34:41.179742 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.196488 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Transition to ACTIVE for port object ea0c67e2-065e-475f-b1ce-c182f3c8ea81 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:41.414753 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.468877 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:41.544871 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Attempting to bind port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:41.545220 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Attempting to bind port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:41.545687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Attempting to bind port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:41.550527 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 on network f307cfd8-e7a3-4489-9872-541459138ccc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:34:41.550863 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Attempting to bind port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:41.556650 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:41.557041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Checking segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:41.557374 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Bound using segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:41.557868 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Bound port: ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:41.558161 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.637004 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:41.640525 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:41.735227 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.768262 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:41.768920 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:41.770256 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] 10.222.0.11 "PUT /v2.0/ports/ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1094 time: 0.9796491 Sep 03 11:34:41.773423 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:41.789300 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed" -d '{"events": [{"name": "network-changed", "server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:41.829918 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ce398e9-fb1e-4127-8903-95c8e00d0b76 x-openstack-request-id: req-2ce398e9-fb1e-4127-8903-95c8e00d0b76 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:41.830206 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:41.830476 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2ce398e9-fb1e-4127-8903-95c8e00d0b76 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:41.830870 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'status': 'completed', 'code': 200} Sep 03 11:34:41.834216 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bbe214-de30-47d3-94a8-a921caca5613 service neutron] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:41.908634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-19c4f9c8-5709-41c0-beab-b52bece7a882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:41.910446 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-19c4f9c8-5709-41c0-beab-b52bece7a882 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1097 time: 0.0489457 Sep 03 11:34:42.023604 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-248fac6f-fd02-4913-aec0-ba1d890e9e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.025106 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-248fac6f-fd02-4913-aec0-ba1d890e9e1c service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=306eebd846b1470cbf044b5d93c25528&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1064839 Sep 03 11:34:42.125898 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-f439641a-fab7-42f2-9f46-b5aee385caae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.127632 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3e3c7f65-64bc-4d3c-ba29-a9156a2baeed req-f439641a-fab7-42f2-9f46-b5aee385caae service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0954332 Sep 03 11:34:42.209488 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a7d8bbc9-16df-4a8f-96cf-f8c00749258b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.211164 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-a7d8bbc9-16df-4a8f-96cf-f8c00749258b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1097 time: 0.0479531 Sep 03 11:34:42.214730 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18124d05-3a09-481d-9770-4d5e8f911586 req-22b851e4-46b0-4d0a-898c-41231f1c378f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.220343 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18124d05-3a09-481d-9770-4d5e8f911586 req-22b851e4-46b0-4d0a-898c-41231f1c378f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0554702 Sep 03 11:34:42.249569 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0c1a0140-6eb6-4bae-ba93-b742e42fed8e no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:42.257838 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18124d05-3a09-481d-9770-4d5e8f911586 req-8b88eaa2-7f15-4ddf-b7fa-b30ae7d9c5a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325022 Sep 03 11:34:42.259669 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-7f29d3a1-1b7b-4e70-818c-b13ff8ed7001 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 217 time: 0.0400422 Sep 03 11:34:42.279021 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 0c1a0140-6eb6-4bae-ba93-b742e42fed8e {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:42.279457 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0c1a0140-6eb6-4bae-ba93-b742e42fed8e not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:42.312584 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-2a18b5ac-f63f-4932-b2f9-e59db5dd98f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.314032 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-2a18b5ac-f63f-4932-b2f9-e59db5dd98f5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0474072 Sep 03 11:34:42.362469 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-ea57eb21-fbe1-4ed1-b9a6-f3a82ae41ce3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:42.364157 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-ea57eb21-fbe1-4ed1-b9a6-f3a82ae41ce3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0426300 Sep 03 11:34:42.461004 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-ec6c35c5-a643-4ffe-92dd-db6773e14077 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886531 Sep 03 11:34:42.556968 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-c6c3fda0-c6e2-4d06-bcf2-1715da7dffc7 req-d6aa7453-9415-4a76-a9ec-e10c8da1fac0 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891378 Sep 03 11:34:42.775704 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37568) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:43.123664 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:43.377060 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Deleting port a435a074-d9b4-4ecd-bff1-866eee3a6408 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:43.377747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:43.378741 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb313247-2937-4840-9703-fecc9c96eeef req-5686874e-bb8b-486d-949b-f5659d331f3a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:43.380297 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fb313247-2937-4840-9703-fecc9c96eeef req-5686874e-bb8b-486d-949b-f5659d331f3a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0487754 Sep 03 11:34:43.420660 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fb313247-2937-4840-9703-fecc9c96eeef req-8e5b4978-3dbf-4722-88a1-95a0eb8e0b0a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341082 Sep 03 11:34:43.459495 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] For port a435a074-d9b4-4ecd-bff1-866eee3a6408, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a435a074-d9b4-4ecd-bff1-866eee3a6408,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:43.459854 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:43.471864 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Calling delete_port for a435a074-d9b4-4ecd-bff1-866eee3a6408 owned by network:router_interface {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:43.747418 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:43.776395 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Pushing event deleted for resources: {'Port': ['ID=a435a074-d9b4-4ecd-bff1-866eee3a6408,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:43.811480 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:43.940246 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.167628 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:44.275056 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:44.282464 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9e2c985d-4e46-4d95-a103-7fff8f9113ae admin admin] 10.222.0.16 "PUT /v2.0/routers/0e1ef25d-6f50-4fcf-b63f-5954f4caac2f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5032244 Sep 03 11:34:44.282582 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:34:44.282705 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37582) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:44.287699 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Sync routers for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:44.307658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:44.308308 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:44.393707 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.477413 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:44.495554 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:44.524090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:34:44.584660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7005d082-7278-4def-9e1b-296bcf78f347 req-8e17805c-33a9-4add-8bea-519d775102e7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:44.593772 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7005d082-7278-4def-9e1b-296bcf78f347 req-8e17805c-33a9-4add-8bea-519d775102e7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0814140 Sep 03 11:34:44.652124 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7005d082-7278-4def-9e1b-296bcf78f347 req-f35aac7f-7f57-47a9-8995-defc69860151 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545068 Sep 03 11:34:44.752943 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.769422 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.788305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:34:44.817898 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:44.865034 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236'}], 'enable_snat': True}, 'gw_port_id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:34:43Z', 'revision_number': 5, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port': {'id': 'dc1a589c-41dc-4456-9396-a689cbcdfdac', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:e5:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 311, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.236', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:31:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:44.885019 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Deleting port dc1a589c-41dc-4456-9396-a689cbcdfdac {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:44.888467 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.893727 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Checking router: 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:44.904489 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Routers {'0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:44.905871 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:44.944947 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.971611 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] For port dc1a589c-41dc-4456-9396-a689cbcdfdac, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=dc1a589c-41dc-4456-9396-a689cbcdfdac,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:44.972115 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:44.990186 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Calling delete_port for dc1a589c-41dc-4456-9396-a689cbcdfdac owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:45.051015 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] Set router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f gateway port host: None {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:45.110293 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:45.114013 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:34:44Z', 'revision_number': 6, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:45.148979 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdfa34a6-a186-4e85-925a-4eba0a8324ba None None] The sync data for ids ['0e1ef25d-6f50-4fcf-b63f-5954f4caac2f'] in dv-cinder-760199-12-iscsi is: [{'id': '0e1ef25d-6f50-4fcf-b63f-5954f4caac2f', 'name': 'tempest-TestMinimumBasicScenario-135791580-router', 'tenant_id': 'a929f96c596b45e78449a64936959efe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:39Z', 'updated_at': '2021-09-03T11:34:44Z', 'revision_number': 6, 'project_id': 'a929f96c596b45e78449a64936959efe', 'gw_port_host': None}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:45.166161 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['ea0c67e2-065e-475f-b1ce-c182f3c8ea81'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:34:45.250772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.286748 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Pushing event deleted for resources: {'Port': ['ID=dc1a589c-41dc-4456-9396-a689cbcdfdac,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:45.342748 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.433268 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.435719 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.565299 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.565710 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0e1ef25d-6f50-4fcf-b63f-5954f4caac2f {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:34:45.570898 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.571983 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-521b5c35-da71-4a04-a8a7-997c25380588 admin admin] 10.222.0.16 "DELETE /v2.0/routers/0e1ef25d-6f50-4fcf-b63f-5954f4caac2f HTTP/1.1" status: 204 len: 168 time: 1.2886159 Sep 03 11:34:45.574648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37642) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:45.624270 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Deleting subnet fe371eea-dd00-405f-8801-d52a715cf14f {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:34:45.627539 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.665051 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.808304 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:45.848090 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b95bb1-56fb-4bc5-a858-95e870f1905c req-e4cff144-e360-489e-a054-6534b29fd3e3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:45.850200 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-71b95bb1-56fb-4bc5-a858-95e870f1905c req-e4cff144-e360-489e-a054-6534b29fd3e3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.1241531 Sep 03 11:34:45.901699 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-71b95bb1-56fb-4bc5-a858-95e870f1905c req-676d5e42-241e-48c6-a91b-61fb7d0eb7b2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445566 Sep 03 11:34:45.980260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.007890 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe371eea-dd00-405f-8801-d52a715cf14f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:46.011708 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.013634 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8425b550-280e-4e16-a5a3-1c430e2c4a8c admin admin] 10.222.0.16 "DELETE /v2.0/subnets/fe371eea-dd00-405f-8801-d52a715cf14f HTTP/1.1" status: 204 len: 168 time: 0.4371867 Sep 03 11:34:46.016285 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37650) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:46.019086 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ddcd6dc-2103-40cc-bede-037b9b5ca022 None None] Network f39e51e6-3ab9-4955-9302-06484ab5c362 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:46.096817 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.162474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Deleting port a3fe56c8-8be1-4be7-809b-ef2dda0859bd {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:46.162750 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.210768 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] DHCP port deletion for f39e51e6-3ab9-4955-9302-06484ab5c362 request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:34:46.253970 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] For port a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:46.254418 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.267241 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Calling delete_port for a3fe56c8-8be1-4be7-809b-ef2dda0859bd owned by network:dhcp {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:46.271127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Deleting port a3fe56c8-8be1-4be7-809b-ef2dda0859bd {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:46.271543 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.330093 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:46.369854 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] For port a3fe56c8-8be1-4be7-809b-ef2dda0859bd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,segment=NetworkSegment(c499ba7c-8196-4f0f-a2b8-db6c7f79d569),segment_id=c499ba7c-8196-4f0f-a2b8-db6c7f79d569)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:46.370297 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.387918 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Calling delete_port for a3fe56c8-8be1-4be7-809b-ef2dda0859bd owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:46.439102 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.467231 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Pushing event deleted for resources: {'Port': ['ID=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:46.476314 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] No DVR routers for this DVR port a3fe56c8-8be1-4be7-809b-ef2dda0859bd on host dv-cinder-760199-12-iscsi {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:46.526214 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.534154 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:46.553442 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.556960 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] Pushing event deleted for resources: {'Port': ['ID=a3fe56c8-8be1-4be7-809b-ef2dda0859bd,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:46.558872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6707656-de6a-4669-aa6e-0f09ac69b6d2 None None] No DVR routers for this DVR port a3fe56c8-8be1-4be7-809b-ef2dda0859bd on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:46.560137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:46.560506 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.570251 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f39e51e6-3ab9-4955-9302-06484ab5c362']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:46.584085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:46.584284 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c499ba7c-8196-4f0f-a2b8-db6c7f79d569') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:46.593568 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.607927 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.615359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Releasing vlan 353 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:34:46.615854 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:34:46.617550 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:34:46.649878 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.672942 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:46.675290 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1dcefb06-6451-431a-8f0b-baaa0f98a713" -d '{"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:46.688761 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:46.713997 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6f0b977-40ad-4d3f-81bb-0de4d8afe97c x-openstack-request-id: req-f6f0b977-40ad-4d3f-81bb-0de4d8afe97c {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:46.714508 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:46.714950 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-f6f0b977-40ad-4d3f-81bb-0de4d8afe97c {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:46.715519 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'code': 200} Sep 03 11:34:46.745697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.753125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.758687 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] 10.222.0.16 "DELETE /v2.0/networks/f39e51e6-3ab9-4955-9302-06484ab5c362 HTTP/1.1" status: 204 len: 168 time: 0.7372022 Sep 03 11:34:46.758687 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37658) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:46.759340 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:46.773360 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63531e4-0e75-428f-bfe9-8c0930626e83 admin admin] Pushing event deleted for resources: {'Network': ['ID=f39e51e6-3ab9-4955-9302-06484ab5c362,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:46.810681 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:46.890290 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device dc1a589c-41dc-4456-9396-a689cbcdfdac no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:46.910173 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: dc1a589c-41dc-4456-9396-a689cbcdfdac {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:46.910539 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device dc1a589c-41dc-4456-9396-a689cbcdfdac not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:46.910949 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a435a074-d9b4-4ecd-bff1-866eee3a6408 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:46.930143 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: a435a074-d9b4-4ecd-bff1-866eee3a6408 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:46.930504 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a435a074-d9b4-4ecd-bff1-866eee3a6408 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:46.930923 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a3fe56c8-8be1-4be7-809b-ef2dda0859bd no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:46.954752 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: a3fe56c8-8be1-4be7-809b-ef2dda0859bd {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:46.958543 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device a3fe56c8-8be1-4be7-809b-ef2dda0859bd not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:47.039478 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293129be-b7c9-47a2-b9f9-dbf5c5885996 req-c7a5d81d-2b79-479a-96af-faf8bb6e259a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:47.040974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-293129be-b7c9-47a2-b9f9-dbf5c5885996 req-c7a5d81d-2b79-479a-96af-faf8bb6e259a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0581827 Sep 03 11:34:47.082519 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-293129be-b7c9-47a2-b9f9-dbf5c5885996 req-3f265a0f-9569-4971-9d91-aeee33f1c7c5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354943 Sep 03 11:34:47.165832 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1daa9cc-b5aa-4a4e-9352-9f86a64274f2 req-7d4ed7cc-a5f0-43ae-827e-d01e1c6dcb14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:47.167939 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f1daa9cc-b5aa-4a4e-9352-9f86a64274f2 req-7d4ed7cc-a5f0-43ae-827e-d01e1c6dcb14 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1099 time: 0.0731514 Sep 03 11:34:47.216525 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-f1daa9cc-b5aa-4a4e-9352-9f86a64274f2 req-28a370da-fe2b-4ad5-867e-cf766dcd7017 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406048 Sep 03 11:34:47.222004 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:47.471750 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Deleting port 326f79cc-141e-458a-90e2-e269ba7aae4a {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:47.472489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:47.551800 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] For port 326f79cc-141e-458a-90e2-e269ba7aae4a, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=326f79cc-141e-458a-90e2-e269ba7aae4a,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:47.552382 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:47.565759 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Calling delete_port for 326f79cc-141e-458a-90e2-e269ba7aae4a owned by network:router_interface {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:47.803372 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:47.835736 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Pushing event deleted for resources: {'Port': ['ID=326f79cc-141e-458a-90e2-e269ba7aae4a,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:47.950537 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:34:48.013630 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:48.207151 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46036058-3132-47f9-ad6d-02806c8bdc17 req-65387495-3474-42b2-a1e3-6e62cf24b723 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:48.209298 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46036058-3132-47f9-ad6d-02806c8bdc17 req-65387495-3474-42b2-a1e3-6e62cf24b723 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0513661 Sep 03 11:34:48.240903 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:48.249619 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46036058-3132-47f9-ad6d-02806c8bdc17 req-20fd2a69-f492-49ce-a79c-84bbe0f4fa7a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343828 Sep 03 11:34:48.586151 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:48.591153 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a4c8fb55-b8f9-4f2c-8728-20c46dbf648a admin admin] 10.222.0.16 "PUT /v2.0/routers/e1b214ac-b2cb-4ef0-9765-26d72e898bb5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8318524 Sep 03 11:34:48.593756 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37672) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:48.597981 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Sync routers for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:48.608714 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:48.609279 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:48.709914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:48.722752 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:48.815730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:48.941704 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Deleting port aab5a8cf-41e7-41a3-9f51-29c9da9fae99 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:48.942049 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:48.994788 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211'}], 'enable_snat': True}, 'gw_port_id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:34:47Z', 'revision_number': 5, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port': {'id': 'aab5a8cf-41e7-41a3-9f51-29c9da9fae99', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:95:26:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.211', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:31:48Z', 'updated_at': '2021-09-03T11:31:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:49.024283 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Checking router: e1b214ac-b2cb-4ef0-9765-26d72e898bb5 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:49.026271 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] For port aab5a8cf-41e7-41a3-9f51-29c9da9fae99, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:49.026767 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.032926 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Routers {'e1b214ac-b2cb-4ef0-9765-26d72e898bb5'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:49.033552 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:49.040943 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Calling delete_port for aab5a8cf-41e7-41a3-9f51-29c9da9fae99 owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:49.119336 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] Set router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:49.170534 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:34:48Z', 'revision_number': 6, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:49.203758 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dee67e2c-c6a4-4d6b-bd89-8c0c65b6a7b6 None None] The sync data for ids ['e1b214ac-b2cb-4ef0-9765-26d72e898bb5'] in dv-cinder-760199-12-iscsi is: [{'id': 'e1b214ac-b2cb-4ef0-9765-26d72e898bb5', 'name': 'tempest-TestMinimumBasicScenario-1010211996-router', 'tenant_id': '2c2593c16b3940079fbd6cd69d8384ee', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:31:47Z', 'updated_at': '2021-09-03T11:34:48Z', 'revision_number': 6, 'project_id': '2c2593c16b3940079fbd6cd69d8384ee', 'gw_port_host': None}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:49.261832 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.288657 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Pushing event deleted for resources: {'Port': ['ID=aab5a8cf-41e7-41a3-9f51-29c9da9fae99,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:49.353674 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.384870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f2d4f5-3a53-4303-8cb3-2c9b25f05d10 req-f7332e0f-de56-4fe6-9552-24e51036d0e5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:49.386501 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9f2d4f5-3a53-4303-8cb3-2c9b25f05d10 req-f7332e0f-de56-4fe6-9552-24e51036d0e5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0631957 Sep 03 11:34:49.434121 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f9f2d4f5-3a53-4303-8cb3-2c9b25f05d10 req-630afbf4-a024-4c9e-8a0d-74bb97f03e68 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409384 Sep 03 11:34:49.446907 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.449053 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.545906 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.546371 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1b214ac-b2cb-4ef0-9765-26d72e898bb5 {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:34:49.551451 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.553288 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-44d3c995-4fce-413d-a947-86c2fb7d29ff admin admin] 10.222.0.16 "DELETE /v2.0/routers/e1b214ac-b2cb-4ef0-9765-26d72e898bb5 HTTP/1.1" status: 204 len: 168 time: 0.9584713 Sep 03 11:34:49.555685 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37680) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:49.570788 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5cef51-a69d-478c-a091-a8d366933a8c req-9b12ecfe-7d79-4209-8eb9-5bbc15e384b5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:49.572309 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4f5cef51-a69d-478c-a091-a8d366933a8c req-9b12ecfe-7d79-4209-8eb9-5bbc15e384b5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0647891 Sep 03 11:34:49.581834 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37682) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:49.587301 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'floatingip': {'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:49.627087 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Deleting subnet c0748bec-114c-4f3f-b270-c063a7c46018 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:34:49.630552 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.643409 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.669325 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.757394 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.879426 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.908405 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:49.910462 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] 10.222.0.16 "DELETE /v2.0/subnets/c0748bec-114c-4f3f-b270-c063a7c46018 HTTP/1.1" status: 204 len: 168 time: 0.3538072 Sep 03 11:34:49.912833 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0c8efc-852f-45f7-8a54-802337adaf7b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c0748bec-114c-4f3f-b270-c063a7c46018,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:49.914588 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37686) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:49.922461 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86250afa-bcd7-48b5-be5e-cf0ae29bff4a None None] Network 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:49.995468 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.080092 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Deleting port 20fd8d80-792f-4393-9d37-f04a2b0fee50 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:50.080433 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.142747 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] DHCP port deletion for 20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:34:50.156873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] For port 20fd8d80-792f-4393-9d37-f04a2b0fee50, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=20fd8d80-792f-4393-9d37-f04a2b0fee50,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:50.157658 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.170681 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Calling delete_port for 20fd8d80-792f-4393-9d37-f04a2b0fee50 owned by network:dhcp {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:50.190213 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Deleting port 20fd8d80-792f-4393-9d37-f04a2b0fee50 {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:34:50.190642 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.233656 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.267643 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] For port 20fd8d80-792f-4393-9d37-f04a2b0fee50, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=20fd8d80-792f-4393-9d37-f04a2b0fee50,segment=NetworkSegment(ba46573e-40c4-4961-924a-39b8685975d0),segment_id=ba46573e-40c4-4961-924a-39b8685975d0)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:50.268059 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.281990 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Calling delete_port for 20fd8d80-792f-4393-9d37-f04a2b0fee50 owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:34:50.305879 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.343384 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.376072 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Pushing event deleted for resources: {'Port': ['ID=20fd8d80-792f-4393-9d37-f04a2b0fee50,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:50.379994 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] No DVR routers for this DVR port 20fd8d80-792f-4393-9d37-f04a2b0fee50 on host dv-cinder-760199-12-iscsi {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:50.435046 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Floating IP 4845804a-0864-472e-90ea-80e2153aa5eb associated. External IP: 172.27.0.126, port: ea0c67e2-065e-475f-b1ce-c182f3c8ea81. Sep 03 11:34:50.466333 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.487185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:50.502762 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ba46573e-40c4-4961-924a-39b8685975d0') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:50.503106 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ba46573e-40c4-4961-924a-39b8685975d0') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:50.512534 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.515076 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.529242 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.535484 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Releasing vlan 386 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:34:50.535876 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:34:50.538192 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:34:50.545090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] Pushing event deleted for resources: {'Port': ['ID=20fd8d80-792f-4393-9d37-f04a2b0fee50,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:50.550066 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5bbd4f6-ecf5-4599-9b27-b8a5a1d83e72 None None] No DVR routers for this DVR port 20fd8d80-792f-4393-9d37-f04a2b0fee50 on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:34:50.667859 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.673352 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.675651 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] 10.222.0.16 "DELETE /v2.0/networks/20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95 HTTP/1.1" status: 204 len: 168 time: 0.7599661 Sep 03 11:34:50.682702 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:50.688518 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80822751-eb25-48db-922a-1f2fc2a1afc4 admin admin] Pushing event deleted for resources: {'Network': ['ID=20de9e4d-e7a9-4c2f-80b1-19f9fe4f3f95,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:50.801201 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:50.807147 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:50.812760 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:50.822520 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:50.823081 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:50.910949 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device aab5a8cf-41e7-41a3-9f51-29c9da9fae99 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:50.935620 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: aab5a8cf-41e7-41a3-9f51-29c9da9fae99 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:50.936428 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device aab5a8cf-41e7-41a3-9f51-29c9da9fae99 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:50.936428 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 326f79cc-141e-458a-90e2-e269ba7aae4a no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:50.963639 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 326f79cc-141e-458a-90e2-e269ba7aae4a {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:50.963942 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 326f79cc-141e-458a-90e2-e269ba7aae4a not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:50.964314 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 20fd8d80-792f-4393-9d37-f04a2b0fee50 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:34:50.989054 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 20fd8d80-792f-4393-9d37-f04a2b0fee50 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:34:50.990021 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 20fd8d80-792f-4393-9d37-f04a2b0fee50 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:34:51.013985 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:51.051730 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37694) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:51.075553 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-597fe091-9766-4ffa-88df-6d199006f680 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "PUT /v2.0/floatingips/4845804a-0864-472e-90ea-80e2153aa5eb HTTP/1.1" status: 200 len: 992 time: 1.4900265 Sep 03 11:34:51.075553 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:34:51.076634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8" -d '{"events": [{"name": "network-changed", "server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:34:51.104753 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e979bf25-755b-46e4-b539-d45b2ad7a8ad admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a929f96c596b45e78449a64936959efe&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0492270 Sep 03 11:34:51.105003 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37700) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:51.137678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:34:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7221c763-289e-4e20-a1d8-834fdb6d563e x-openstack-request-id: req-7221c763-289e-4e20-a1d8-834fdb6d563e {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:34:51.138021 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:34:51.138276 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-7221c763-289e-4e20-a1d8-834fdb6d563e {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:34:51.138698 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'status': 'completed', 'code': 200} Sep 03 11:34:51.177515 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:51.209746 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:51.224143 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-96deefd9-1e7a-457a-b441-99485b686c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:51.225591 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-96deefd9-1e7a-457a-b441-99485b686c05 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1099 time: 0.0540693 Sep 03 11:34:51.281846 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '4845804a-0864-472e-90ea-80e2153aa5eb', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.126', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:36Z', 'updated_at': '2021-09-03T11:34:50Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:51.308195 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:51.316780 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:51.317218 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:51.318658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:51.319990 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:51.321155 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f132ebc1-0d3b-402f-888c-c905d3a1e882 HTTP/1.1" status: 204 len: 168 time: 0.2151971 Sep 03 11:34:51.329266 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74408533-af41-47c8-883e-19c35aaec45b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f132ebc1-0d3b-402f-888c-c905d3a1e882,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:51.340851 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-ad1d76a7-8037-4d80-bbc1-fbceba761e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:51.342409 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-ad1d76a7-8037-4d80-bbc1-fbceba761e1a service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.1085589 Sep 03 11:34:51.418818 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-3348085e-f60a-4054-a7ee-309a33b0d5e2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1000 time: 0.0679193 Sep 03 11:34:51.444125 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:51.472439 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-016398e5-e418-4e5e-9943-5a56da332ce0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:51.475042 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-016398e5-e418-4e5e-9943-5a56da332ce0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0468366 Sep 03 11:34:51.533009 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-96119663-31f6-4821-9b89-611e1cd4ccbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:51.534568 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-96119663-31f6-4821-9b89-611e1cd4ccbd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0522883 Sep 03 11:34:51.635703 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-35be3ed8-d6f7-4a15-9e69-55ae091b829a service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916297 Sep 03 11:34:51.702826 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '4845804a-0864-472e-90ea-80e2153aa5eb', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.126', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:36Z', 'updated_at': '2021-09-03T11:34:50Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:51.730546 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2397618-a259-40c2-9d88-c255c0ac13f9 None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '4845804a-0864-472e-90ea-80e2153aa5eb', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.126', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 490, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:34:36Z', 'updated_at': '2021-09-03T11:34:50Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:51.746658 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-1b2cb92c-14f5-4da8-8bd7-60a03b8592f8 req-09c081fc-b990-43c2-9b92-34ee7f357968 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1031692 Sep 03 11:34:51.922860 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34d7c199-6a97-41cb-87b1-9287a5d535bf None None] New status for floating IP 4845804a-0864-472e-90ea-80e2153aa5eb: ACTIVE {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:34:51.972455 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37710) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:52.017073 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-4e618d8e-6da2-4fd9-94fe-bc7d9d20a76e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2c2593c16b3940079fbd6cd69d8384ee&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0432975 Sep 03 11:34:52.019379 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37712) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:52.075808 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:52.096855 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:52.205660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:52.210397 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:52.211729 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/12eef4dc-5416-4628-a9a0-05395658806e HTTP/1.1" status: 204 len: 168 time: 0.1914332 Sep 03 11:34:52.222358 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39ba4dad-8426-49ff-ae94-91484a125c68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12eef4dc-5416-4628-a9a0-05395658806e,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:53.216704 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37740) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:53.316029 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-924198080-network', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:53.391422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Made reservation on behalf of f29a932166fe443d8e6a5014f9de527d for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:53.393763 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.405429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.495461 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.562991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.587759 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] vlan segment allocate from pool success with {'vlan_id': 397, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:34:53.602167 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3475655c-ed12-4c95-946d-9ced5ceff2a0,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:53.608654 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.608997 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Added segment b65e6ba6-095f-4de7-a881-ad7c6d65ef16 of type vlan for network a673d589-6e7c-4ca2-8a0c-89d350ececf8 Sep 03 11:34:53.658630 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.683154 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a2edd241-2f0a-4b08-b4fb-6ff0b2845555 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.728642 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.729795 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:53.730538 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:53.793680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] Pushing event updated for resources: {'Network': ['ID=a673d589-6e7c-4ca2-8a0c-89d350ececf8,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:53.804433 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:34:53.819025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2c7483fc-611d-4424-84f0-2f04711cc918 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5970471 Sep 03 11:34:53.819025 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37748) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:53.823928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Request body: {'subnet': {'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-924198080-subnet', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:53.913188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Made reservation on behalf of f29a932166fe443d8e6a5014f9de527d for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:53.915573 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.365813 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.425531 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Pushing event updated for resources: {'Subnet': ['ID=610178de-2f3b-4c7b-a5c7-46ef7f74ed76,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:54.436511 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Checking segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:54.436860 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Network hostable DHCP agents. Network: a673d589-6e7c-4ca2-8a0c-89d350ececf8, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:34:54.522777 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:34:54.597088 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, a673d589-6e7c-4ca2-8a0c-89d350ececf8) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:54.601312 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:34:54.601914 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.606495 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b2e50b1-fc4c-4e75-b781-ca6b47156bf7 None None] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:54.678188 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5b8f1cbe-efa1-4660-a2dc-fc94e7aba695 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.8579738 Sep 03 11:34:54.681096 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37756) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:54.689086 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:54.767925 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:34:54.768827 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.780253 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.781312 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.835947 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:54.907120 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Allocated IP 172.20.0.2 (a673d589-6e7c-4ca2-8a0c-89d350ececf8/610178de-2f3b-4c7b-a5c7-46ef7f74ed76/902833bb-f173-4fce-bd8b-4a4ad7305ffd) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:55.051872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.056564 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.064759 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Transition to ACTIVE for port object 902833bb-f173-4fce-bd8b-4a4ad7305ffd will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:55.079521 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Transition to ACTIVE for port object 902833bb-f173-4fce-bd8b-4a4ad7305ffd will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:55.165293 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.211239 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:55.214856 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:55.217341 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:55.227607 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Pushing event updated for resources: {'Port': ['ID=902833bb-f173-4fce-bd8b-4a4ad7305ffd,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:55.286287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Attempting to bind port 902833bb-f173-4fce-bd8b-4a4ad7305ffd on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:55.286760 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Attempting to bind port 902833bb-f173-4fce-bd8b-4a4ad7305ffd by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:55.287252 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Attempting to bind port 902833bb-f173-4fce-bd8b-4a4ad7305ffd on network a673d589-6e7c-4ca2-8a0c-89d350ececf8 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:55.292301 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:55.292670 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Checking segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:55.293064 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.293451 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Bound using segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:55.293905 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Bound port: 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:55.294285 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.338101 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.359342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.360124 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] For port 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:55.363156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] For port 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=902833bb-f173-4fce-bd8b-4a4ad7305ffd,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:55.428496 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.478975 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Allocated IP 172.27.0.20 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/df7e3022-1070-4742-bd7a-23d9b4349284) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:55.492232 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77df7de8-9a56-4743-8593-5c0794a521f1 None None] Pushing event updated for resources: {'Port': ['ID=902833bb-f173-4fce-bd8b-4a4ad7305ffd,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:55.602212 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.708841 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:55.750773 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:55.753735 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:55.757641 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:55.766627 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Pushing event updated for resources: {'Port': ['ID=df7e3022-1070-4742-bd7a-23d9b4349284,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:56.117259 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:56.324918 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:56.336847 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-00b275a4-0f30-4af0-a2f2-1595130eafc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:56.445659 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de8948f3-e7b9-4ef1-9d87-87e3a36f91e4 None None] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:34:56.513245 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Router 5de10b45-f5e8-4001-950d-d88a63808984 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94432) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:34:56.631157 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:56.644581 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-aede4244-2ea2-4159-a814-756584b10abc None None] Provisioning for port 902833bb-f173-4fce-bd8b-4a4ad7305ffd completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:56.648638 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Sync routers for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:34:56.669612 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:56.670312 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:56.732652 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:56.741867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:56.743795 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-930cf619-0e2b-4ce5-8b83-3b434cf765ae admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.0616426 Sep 03 11:34:56.746955 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37774) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:56.798925 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:56.934188 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 902833bb-f173-4fce-bd8b-4a4ad7305ffd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:57.043433 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:55Z', 'revision_number': 3, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:57.070782 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Checking router: 5de10b45-f5e8-4001-950d-d88a63808984 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:34:57.071135 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Updating router 5de10b45-f5e8-4001-950d-d88a63808984 port df7e3022-1070-4742-bd7a-23d9b4349284 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:34:57.093508 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 902833bb-f173-4fce-bd8b-4a4ad7305ffd completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:57.102343 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 902833bb-f173-4fce-bd8b-4a4ad7305ffd triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:57.102805 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.104398 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.182320 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.344984 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Allocated IP 172.20.0.1 (a673d589-6e7c-4ca2-8a0c-89d350ececf8/610178de-2f3b-4c7b-a5c7-46ef7f74ed76/57dc65d4-44cf-4aa9-a7f9-04075564886f) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:34:57.413414 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.455845 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.470235 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Transition to ACTIVE for port object 57dc65d4-44cf-4aa9-a7f9-04075564886f will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:57.482404 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=902833bb-f173-4fce-bd8b-4a4ad7305ffd,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:34:57.570945 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.573704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.591529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.611592 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Transition to ACTIVE for port object df7e3022-1070-4742-bd7a-23d9b4349284 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:34:57.634880 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=902833bb-f173-4fce-bd8b-4a4ad7305ffd,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:57.637128 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:57.640678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:57.644438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:34:57.671539 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Pushing event updated for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:57.689115 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.690788 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.708653 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.769280 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Attempting to bind port df7e3022-1070-4742-bd7a-23d9b4349284 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:34:57.769644 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Attempting to bind port df7e3022-1070-4742-bd7a-23d9b4349284 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:34:57.770007 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Attempting to bind port df7e3022-1070-4742-bd7a-23d9b4349284 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:34:57.773732 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6cc450-906d-4505-8877-d18407dbf990 None None] Pushing event updated for resources: {'Port': ['ID=df7e3022-1070-4742-bd7a-23d9b4349284,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:57.778556 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:34:57.778932 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:34:57.779334 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.779856 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:34:57.780329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Bound port: df7e3022-1070-4742-bd7a-23d9b4349284, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:34:57.780711 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.838103 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] For port df7e3022-1070-4742-bd7a-23d9b4349284, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:34:57.841413 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] For port df7e3022-1070-4742-bd7a-23d9b4349284, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=df7e3022-1070-4742-bd7a-23d9b4349284,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:34:57.921041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.942847 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:57.993506 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:34:57.994124 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:58.035018 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d6cc450-906d-4505-8877-d18407dbf990 None None] Pushing event updated for resources: {'Port': ['ID=df7e3022-1070-4742-bd7a-23d9b4349284,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:58.068948 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-30fba256-96f7-445e-a4eb-4497ed5e5f33 None None] Provisioning for port 57dc65d4-44cf-4aa9-a7f9-04075564886f completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:34:58.076804 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-30fba256-96f7-445e-a4eb-4497ed5e5f33 None None] Provisioning complete for port 57dc65d4-44cf-4aa9-a7f9-04075564886f triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:58.077185 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-30fba256-96f7-445e-a4eb-4497ed5e5f33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:58.094866 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:58.126356 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-30fba256-96f7-445e-a4eb-4497ed5e5f33 None None] Port 57dc65d4-44cf-4aa9-a7f9-04075564886f cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:58.139698 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:34:58.164606 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:58.232819 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:58.235519 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Pushing event updated for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:58.345487 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 1, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:34:58.372853 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ab7029d-cf80-4840-813c-51e1f6501cd1 None None] The sync data for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi is: [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 1, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:34:58.581037 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:34:58.582706 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:34:58.709723 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Router 5de10b45-f5e8-4001-950d-d88a63808984 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:34:58.824190 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:34:58.833186 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-02297183-384b-491d-8cb7-1a306b3efc52 admin admin] 10.222.0.16 "PUT /v2.0/routers/5de10b45-f5e8-4001-950d-d88a63808984/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0811541 Sep 03 11:34:58.855319 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-04aa2478-2210-4375-8111-bba89c15f9c7 None None] Provisioning complete for port 57dc65d4-44cf-4aa9-a7f9-04075564886f triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:58.855789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-04aa2478-2210-4375-8111-bba89c15f9c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:58.924104 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 902833bb-f173-4fce-bd8b-4a4ad7305ffd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:34:58.929391 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-04aa2478-2210-4375-8111-bba89c15f9c7 None None] Port 57dc65d4-44cf-4aa9-a7f9-04075564886f cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:34:59.000680 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 902833bb-f173-4fce-bd8b-4a4ad7305ffd triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:34:59.001119 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.054816 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.556250 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37810) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:34:59.561729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2028482626-network', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:34:59.694101 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Made reservation on behalf of a2b5661993e2477a82653f40eb1c137c for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:34:59.696449 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.705501 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.803293 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.878905 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.904538 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] vlan segment allocate from pool success with {'vlan_id': 355, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:34:59.914500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f0355b6-f2a3-4a1b-98f4-2aedf7c76b00,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:34:59.919351 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:34:59.919700 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Added segment 1be7b8ca-935c-4fea-864b-4a5cc8c5ad68 of type vlan for network 42595304-bece-4cdb-988d-e92d7edf5d52 Sep 03 11:34:59.960805 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.050164 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.051225 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:00.052472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.118696 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] Pushing event updated for resources: {'Network': ['ID=42595304-bece-4cdb-988d-e92d7edf5d52,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:00.128592 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 42595304-bece-4cdb-988d-e92d7edf5d52 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:35:00.140341 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-cd713194-7607-4a2a-b630-e436ef4a3b3d admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5824876 Sep 03 11:35:00.143061 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37818) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:00.148174 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Request body: {'subnet': {'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2028482626-subnet', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:00.250405 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Made reservation on behalf of a2b5661993e2477a82653f40eb1c137c for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:35:00.252786 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-260563317'] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.324916 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Sync routers for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:00.334456 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:00.335386 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:00.438019 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:00.477197 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-260546019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-260563291'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.531634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=e532f019-f402-40c4-9ca4-47c4bdbcdd5c,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:00.542662 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Checking segment: {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:00.543015 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Network hostable DHCP agents. Network: 42595304-bece-4cdb-988d-e92d7edf5d52, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:35:00.631167 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Network 42595304-bece-4cdb-988d-e92d7edf5d52 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:35:00.636252 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 2, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:00.665611 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Checking router: 5de10b45-f5e8-4001-950d-d88a63808984 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:00.665955 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Updating router 5de10b45-f5e8-4001-950d-d88a63808984 port 57dc65d4-44cf-4aa9-a7f9-04075564886f binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:35:00.690638 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.705500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 42595304-bece-4cdb-988d-e92d7edf5d52) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:00.714201 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-700a6ba1-1456-4d0b-b1aa-3f78f4c923b7 None None] Network 42595304-bece-4cdb-988d-e92d7edf5d52 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:35:00.717429 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:00.718259 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.804257 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9b8f7d16-5819-4493-ae12-cf554ad0b8ff admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6599629 Sep 03 11:35:00.807407 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 37822) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:00.814578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:00.879377 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-42595304-bece-4cdb-988d-e92d7edf5d52', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:35:00.880676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.902007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.903392 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.972705 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.976945 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:00.980693 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device df7e3022-1070-4742-bd7a-23d9b4349284 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:00.987699 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Transition to ACTIVE for port object 57dc65d4-44cf-4aa9-a7f9-04075564886f will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:01.083182 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Allocated IP 172.20.0.2 (42595304-bece-4cdb-988d-e92d7edf5d52/e532f019-f402-40c4-9ca4-47c4bdbcdd5c/3ff63202-7097-40a2-8f09-6c5fc1df8183) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:01.092109 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.157261 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8287bbd4-8246-4e35-a6bc-9856b4e3bbc0 None None] Pushing event updated for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:01.170121 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port df7e3022-1070-4742-bd7a-23d9b4349284 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:01.180906 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port df7e3022-1070-4742-bd7a-23d9b4349284 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:01.181314 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.226703 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Attempting to bind port 57dc65d4-44cf-4aa9-a7f9-04075564886f on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:01.227401 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Attempting to bind port 57dc65d4-44cf-4aa9-a7f9-04075564886f by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:01.227947 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Attempting to bind port 57dc65d4-44cf-4aa9-a7f9-04075564886f on network a673d589-6e7c-4ca2-8a0c-89d350ececf8 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:01.234045 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:01.234656 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Checking segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:01.235226 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.235763 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Bound using segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:01.236393 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Bound port: 57dc65d4-44cf-4aa9-a7f9-04075564886f, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:01.236789 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.276595 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.312537 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] For port 57dc65d4-44cf-4aa9-a7f9-04075564886f, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:01.314135 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.317949 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] For port 57dc65d4-44cf-4aa9-a7f9-04075564886f, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=57dc65d4-44cf-4aa9-a7f9-04075564886f,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:01.365158 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Transition to ACTIVE for port object 3ff63202-7097-40a2-8f09-6c5fc1df8183 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:01.393732 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.397600 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.401457 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Transition to ACTIVE for port object 3ff63202-7097-40a2-8f09-6c5fc1df8183 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:01.434094 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port df7e3022-1070-4742-bd7a-23d9b4349284, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=df7e3022-1070-4742-bd7a-23d9b4349284,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:01.461749 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:01.462408 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:01.494875 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.557384 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.580225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Network 42595304-bece-4cdb-988d-e92d7edf5d52 is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:01.587680 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:01.589350 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Pushing event updated for resources: {'Port': ['ID=3ff63202-7097-40a2-8f09-6c5fc1df8183,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:01.592521 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:01.596404 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.634196 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.685212 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8287bbd4-8246-4e35-a6bc-9856b4e3bbc0 None None] Pushing event updated for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=4']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:01.710071 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:01.710287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Attempting to bind port 3ff63202-7097-40a2-8f09-6c5fc1df8183 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:01.710661 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Attempting to bind port 3ff63202-7097-40a2-8f09-6c5fc1df8183 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:01.711008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Attempting to bind port 3ff63202-7097-40a2-8f09-6c5fc1df8183 on network 42595304-bece-4cdb-988d-e92d7edf5d52 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:01.712962 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=df7e3022-1070-4742-bd7a-23d9b4349284,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Checking segment: {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Bound using segment: {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Bound port: 3ff63202-7097-40a2-8f09-6c5fc1df8183, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:01.725217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.777782 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Allocated IP 172.27.0.107 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/e8de3f44-9db6-4753-bbbc-b4ca918acd64) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:01.792282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] For port 3ff63202-7097-40a2-8f09-6c5fc1df8183, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:01.808030 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] For port 3ff63202-7097-40a2-8f09-6c5fc1df8183, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=3ff63202-7097-40a2-8f09-6c5fc1df8183,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:01.873672 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.907274 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:01.935817 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce016042-0f19-4abd-a7b3-c7058eaa4fc8 None None] Pushing event updated for resources: {'Port': ['ID=3ff63202-7097-40a2-8f09-6c5fc1df8183,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:01.947834 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:01.980399 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712e78d9-59f9-4606-a697-9d8635812332 None None] The sync data for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi is: [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:35:02.048989 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:02.122477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:02.140883 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:02.142891 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Pushing event updated for resources: {'Port': ['ID=e8de3f44-9db6-4753-bbbc-b4ca918acd64,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:02.145368 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:02.485079 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:02.681093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:02.882230 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c05ca1f2-2d11-4360-87f8-3baf2e5958ff None None] Network 42595304-bece-4cdb-988d-e92d7edf5d52 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:35:02.897185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Router 87b7295f-d3a9-435f-af59-d880c0855fe2 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94433) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:35:03.032226 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 3ff63202-7097-40a2-8f09-6c5fc1df8183 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:03.032347 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:35:03.055323 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Sync routers for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:03.059999 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-3c2eb1f6-15f8-4c1e-b127-b38a6248f703 None None] Provisioning for port 3ff63202-7097-40a2-8f09-6c5fc1df8183 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:03.106065 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:03.106720 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:03.119206 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.123227 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f526bfd0-b4de-4fb0-9280-cd76e5d7f4a8 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.3121614 Sep 03 11:35:03.123589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37850) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:03.352636 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:03.411158 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 3ff63202-7097-40a2-8f09-6c5fc1df8183 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:03.415386 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 3ff63202-7097-40a2-8f09-6c5fc1df8183 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:03.415386 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.567971 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.596078 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.651526 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-2fc73937-9777-4430-9423-713d261e701f None None] Provisioning complete for port 3ff63202-7097-40a2-8f09-6c5fc1df8183 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:03.651900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2fc73937-9777-4430-9423-713d261e701f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.654497 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 3ff63202-7097-40a2-8f09-6c5fc1df8183, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=3ff63202-7097-40a2-8f09-6c5fc1df8183,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:03.701361 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:02Z', 'revision_number': 3, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:03.732459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Checking router: 87b7295f-d3a9-435f-af59-d880c0855fe2 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:03.732821 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Updating router 87b7295f-d3a9-435f-af59-d880c0855fe2 port e8de3f44-9db6-4753-bbbc-b4ca918acd64 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:35:03.743166 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Allocated IP 172.20.0.1 (42595304-bece-4cdb-988d-e92d7edf5d52/e532f019-f402-40c4-9ca4-47c4bdbcdd5c/0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:03.776059 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.776833 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device df7e3022-1070-4742-bd7a-23d9b4349284 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:03.831967 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.852313 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.858939 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2fc73937-9777-4430-9423-713d261e701f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:03.866995 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Transition to ACTIVE for port object 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:03.922004 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=3ff63202-7097-40a2-8f09-6c5fc1df8183,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:03.988029 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.022634 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port df7e3022-1070-4742-bd7a-23d9b4349284 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:04.023013 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.034545 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Network 42595304-bece-4cdb-988d-e92d7edf5d52 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:04.038756 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:04.042491 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:04.056512 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.db.api [None req-2fc73937-9777-4430-9423-713d261e701f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=94434) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 03 11:35:04.061973 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG oslo_db.api [None req-2fc73937-9777-4430-9423-713d261e701f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 03 11:35:04.079607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Pushing event updated for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:04.089091 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.213197 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 57dc65d4-44cf-4aa9-a7f9-04075564886f up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:04.291438 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.301060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.316056 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Transition to ACTIVE for port object e8de3f44-9db6-4753-bbbc-b4ca918acd64 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:04.381874 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 57dc65d4-44cf-4aa9-a7f9-04075564886f completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:04.385692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 57dc65d4-44cf-4aa9-a7f9-04075564886f triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:04.386060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.412419 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.460420 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.475426 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ec8125-3312-44d7-be26-121edfe66bab None None] Pushing event updated for resources: {'Port': ['ID=e8de3f44-9db6-4753-bbbc-b4ca918acd64,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:04.480307 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Attempting to bind port e8de3f44-9db6-4753-bbbc-b4ca918acd64 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:04.480669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Attempting to bind port e8de3f44-9db6-4753-bbbc-b4ca918acd64 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:04.481020 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Attempting to bind port e8de3f44-9db6-4753-bbbc-b4ca918acd64 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:04.488488 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:04.489464 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:04.489857 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.490240 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:04.490721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Bound port: e8de3f44-9db6-4753-bbbc-b4ca918acd64, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:04.491094 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.517046 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.553747 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.591926 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Pushing event updated for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:04.594469 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.604828 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] For port e8de3f44-9db6-4753-bbbc-b4ca918acd64, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:04.610045 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] For port e8de3f44-9db6-4753-bbbc-b4ca918acd64, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e8de3f44-9db6-4753-bbbc-b4ca918acd64,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:04.630916 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 57dc65d4-44cf-4aa9-a7f9-04075564886f, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=57dc65d4-44cf-4aa9-a7f9-04075564886f,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:04.686469 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Network 42595304-bece-4cdb-988d-e92d7edf5d52 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:04.687946 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:04.713725 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.751283 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.790793 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ec8125-3312-44d7-be26-121edfe66bab None None] Pushing event updated for resources: {'Port': ['ID=e8de3f44-9db6-4753-bbbc-b4ca918acd64,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:04.793594 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:04.794204 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:04.836187 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Router 87b7295f-d3a9-435f-af59-d880c0855fe2 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:35:04.888433 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-b5ce6b44-033c-4a01-b0b1-7da399af3819 None None] Provisioning for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:04.902369 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-b5ce6b44-033c-4a01-b0b1-7da399af3819 None None] Provisioning complete for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:04.902780 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b5ce6b44-033c-4a01-b0b1-7da399af3819 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:04.939242 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 3ff63202-7097-40a2-8f09-6c5fc1df8183 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:04.976721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:04.982198 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:35:04.990901 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-636e3fd7-bf66-47e6-ac5f-e5346657dc88 admin admin] 10.222.0.16 "PUT /v2.0/routers/87b7295f-d3a9-435f-af59-d880c0855fe2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8660882 Sep 03 11:35:05.006184 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-b5ce6b44-033c-4a01-b0b1-7da399af3819 None None] Port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:35:05.025410 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:05.069211 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 3ff63202-7097-40a2-8f09-6c5fc1df8183 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:05.069585 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.177854 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-c2ea3184-9094-42ae-bfa8-4535e0043460 None None] Provisioning complete for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:05.178230 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c2ea3184-9094-42ae-bfa8-4535e0043460 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.276622 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-c2ea3184-9094-42ae-bfa8-4535e0043460 None None] Port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:35:05.467714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af', 'name': '', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'mac_address': 'fa:16:3e:59:b4:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:03Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 2, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'subnets': [{'id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:05.494167 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aeb6e54-69b7-46de-acd0-84eb81a191a3 None None] The sync data for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi is: [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af', 'name': '', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'mac_address': 'fa:16:3e:59:b4:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:03Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 2, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'subnets': [{'id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:35:05.620674 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37880) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:05.625380 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1629297831', 'description': 'tempest-secgroup-smoke-1629297831 description', 'project_id': 'f29a932166fe443d8e6a5014f9de527d'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:05.713230 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.802080 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.861664 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.891981 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0e7519ce-2af0-4317-9c10-6924af52ed89,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:05.957116 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:05.961347 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f4fc82d8-cd06-4501-aefd-de86d58d7dd9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3368235 Sep 03 11:35:05.961557 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37882) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:05.966047 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:06.100646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.172835 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.303573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.314466 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d33bf1d7-3184-43c4-9eeb-c72ac48e42c9,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:06.380575 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.381844 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9e5b4d45-b99c-4a80-848c-19ef84d8af44 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4194570 Sep 03 11:35:06.384751 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37894) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:06.389557 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:06.499297 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.563381 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.639115 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.657739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64a0fe90-bef9-42af-9ced-d9f144a275cb,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:06.717052 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.718433 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c921baef-ab40-4601-866c-33b1422c3692 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3326991 Sep 03 11:35:06.721189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37896) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:06.725753 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:06.820571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.881812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.953491 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:06.972316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5be03958-df29-42fa-a094-3f869856a98b,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:06.985255 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e8de3f44-9db6-4753-bbbc-b4ca918acd64 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:07.101548 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.102802 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-dd353a7c-e602-495b-aae7-dbe9af5d0359 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3806965 Sep 03 11:35:07.105454 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37898) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:07.109809 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:07.135913 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port e8de3f44-9db6-4753-bbbc-b4ca918acd64 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:07.140198 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port e8de3f44-9db6-4753-bbbc-b4ca918acd64 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:07.140627 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.199107 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.229600 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.249424 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port e8de3f44-9db6-4753-bbbc-b4ca918acd64, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e8de3f44-9db6-4753-bbbc-b4ca918acd64,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:07.259777 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.313373 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.314175 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 57dc65d4-44cf-4aa9-a7f9-04075564886f up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:07.339872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.361529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8b63111-5574-4f9b-a200-7eabb52e1124,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:07.398417 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=e8de3f44-9db6-4753-bbbc-b4ca918acd64,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:07.404817 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Sync routers for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:07.406576 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 57dc65d4-44cf-4aa9-a7f9-04075564886f triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:07.406696 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.416633 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:07.417575 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:07.425626 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.427193 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6bb427f9-24cb-41be-881d-e041eaf5cb75 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3207819 Sep 03 11:35:07.429816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37908) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:07.434962 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:07.538622 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:07.557151 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Project f29a932166fe443d8e6a5014f9de527d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:35:07.562554 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.634575 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.741864 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af', 'name': '', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'mac_address': 'fa:16:3e:59:b4:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:03Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 2, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'subnets': [{'id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:07.753839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.774181 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7050c5cc-f75e-45ad-a8d2-d2682a327cc7,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:07.774759 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Checking router: 87b7295f-d3a9-435f-af59-d880c0855fe2 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:07.775471 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Updating router 87b7295f-d3a9-435f-af59-d880c0855fe2 port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:35:07.800249 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.844620 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:07.845797 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-46a4d434-9794-4af1-a23b-df80de653108 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4149995 Sep 03 11:35:07.848512 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37914) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:07.853346 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'security_group_rule': {'security_group_id': '0e7519ce-2af0-4317-9c10-6924af52ed89', 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:07.899073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37916) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:07.999579 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Project f29a932166fe443d8e6a5014f9de527d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:35:08.009587 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.013394 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d450fba0-ed09-475c-a0c9-95524c5078ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.071045 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.080471 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Transition to ACTIVE for port object 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:08.096257 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.147910 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d450fba0-ed09-475c-a0c9-95524c5078ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.162533 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.191431 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.210154 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83d4166-d8da-457a-91ed-6803e3bdf56c None None] Pushing event updated for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:08.210303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=486e8056-7495-4dd5-8ab8-9f54b44f1c82,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:08.241359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d450fba0-ed09-475c-a0c9-95524c5078ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.270619 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Attempting to bind port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:08.271054 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Attempting to bind port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:08.271432 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Attempting to bind port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af on network 42595304-bece-4cdb-988d-e92d7edf5d52 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:08.277230 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:08.277898 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Checking segment: {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:08.278269 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.278732 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Bound using segment: {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:08.279195 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Bound port: 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:08.282054 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.282195 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d450fba0-ed09-475c-a0c9-95524c5078ec admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ea742e7e0508462a8f1a9f2681171117&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3795567 Sep 03 11:35:08.282945 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37920) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:08.294411 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d450fba0-ed09-475c-a0c9-95524c5078ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e55ea06-ac16-470f-9e22-086d1fc40476,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:08.311079 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.312275 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-001f8017-2429-4749-a43a-d1c94a957d91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4628372 Sep 03 11:35:08.363720 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] For port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:08.367435 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] For port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:08.368745 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.390862 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.423046 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.493559 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:08.494214 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:34:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:08.536734 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.539358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:08.540525 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9e55ea06-ac16-470f-9e22-086d1fc40476 HTTP/1.1" status: 204 len: 168 time: 0.2566543 Sep 03 11:35:08.559741 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa81fc8-e9bb-4ce7-b89b-34ca56fb6345 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e55ea06-ac16-470f-9e22-086d1fc40476,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:08.588243 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83d4166-d8da-457a-91ed-6803e3bdf56c None None] Pushing event updated for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=4']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:08.644130 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:08.865905 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af', 'name': '', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'mac_address': 'fa:16:3e:59:b4:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:03Z', 'updated_at': '2021-09-03T11:35:08Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'subnets': [{'id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:08.896470 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-245b6a6b-6e27-4adb-8f56-6259c87a6f0a None None] The sync data for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi is: [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af', 'name': '', 'network_id': '42595304-bece-4cdb-988d-e92d7edf5d52', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'mac_address': 'fa:16:3e:59:b4:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_interface', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:03Z', 'updated_at': '2021-09-03T11:35:08Z', 'revision_number': 4, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'subnets': [{'id': 'e532f019-f402-40c4-9ca4-47c4bdbcdd5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:35:08.948142 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:09.088239 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:09.092614 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:09.092921 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.186648 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.236036 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:09.336121 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.340977 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e8de3f44-9db6-4753-bbbc-b4ca918acd64 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:09.421906 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:09.442990 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port e8de3f44-9db6-4753-bbbc-b4ca918acd64 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:09.449731 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.659522 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 37990) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:09.775292 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1917125487-network', 'tenant_id': '2dcf476cde84427596b9b0192490da69'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:09.896821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Made reservation on behalf of 2dcf476cde84427596b9b0192490da69 for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:35:09.899155 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.907678 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:09.996679 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.084576 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.109525 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] vlan segment allocate from pool success with {'vlan_id': 367, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:35:10.120353 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cbd1ac9-742a-43cf-8421-c9b8d36af842,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:10.128292 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.128645 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Added segment 8118ee45-fe26-4e61-b528-5af58071eb6c of type vlan for network c725f14d-842c-445d-9fae-44b313e242c1 Sep 03 11:35:10.130784 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.131123 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.131477 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.131817 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.132157 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.132497 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.132834 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.133169 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.133505 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.133833 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.134162 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.134521 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:10.180781 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.261637 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.262699 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:10.263323 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.323715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] Pushing event updated for resources: {'Network': ['ID=c725f14d-842c-445d-9fae-44b313e242c1,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:10.335003 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network c725f14d-842c-445d-9fae-44b313e242c1 details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:35:10.360633 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-5aa349fe-53dc-42ab-a176-2ee06782a6d2 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.6994224 Sep 03 11:35:10.362833 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38010) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:10.371634 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Request body: {'subnet': {'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1917125487-subnet', 'tenant_id': '2dcf476cde84427596b9b0192490da69', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:10.450534 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Made reservation on behalf of 2dcf476cde84427596b9b0192490da69 for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:35:10.452872 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-260563317'] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.690801 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-260546019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-260563291'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.747406 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cb7916f5-99f8-402c-b4ad-af12c8ae4adb,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:10.756553 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Checking segment: {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:10.756909 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Network hostable DHCP agents. Network: c725f14d-842c-445d-9fae-44b313e242c1, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:35:10.833372 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Network c725f14d-842c-445d-9fae-44b313e242c1 is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:35:10.905539 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:10.918893 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, c725f14d-842c-445d-9fae-44b313e242c1) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:10.922967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:10.923685 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:10.938187 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-502d26b0-abd0-4243-80e0-ad3ff13541c5 None None] Network c725f14d-842c-445d-9fae-44b313e242c1 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:35:11.023397 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e165ec81-b562-477d-bc37-40946e4fe3c7 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6558571 Sep 03 11:35:11.030231 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:11.030646 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:11.124610 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5d39ecb-51a6-4df2-84db-d8e82caf8ca4 None None] Network c725f14d-842c-445d-9fae-44b313e242c1 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:35:11.575612 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-fcb20677-0320-4276-8811-93eea1ff75a1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0911710 Sep 03 11:35:11.671273 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-8d21fa85-45c3-44f1-83ec-b3094b3d22e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:11.672777 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-8d21fa85-45c3-44f1-83ec-b3094b3d22e4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 1098 time: 0.0419841 Sep 03 11:35:11.783228 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-519e7f62-6b69-4c3f-8e96-76d79b673fd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:11.783891 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-519e7f62-6b69-4c3f-8e96-76d79b673fd9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 200 len: 910 time: 0.0907474 Sep 03 11:35:12.104695 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-61d0271e-5857-434b-8a69-f9510a6aa33f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8 HTTP/1.1" status: 200 len: 1000 time: 0.3122005 Sep 03 11:35:12.158785 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-1b51f75e-d8de-4d59-8244-9da232616672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:12.222565 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-1b51f75e-d8de-4d59-8244-9da232616672 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 200 len: 848 time: 0.0464911 Sep 03 11:35:12.222565 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-d29348f4-e577-46c8-8a64-f27700ff0bb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:12.222565 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-d29348f4-e577-46c8-8a64-f27700ff0bb3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=246bd34f-94aa-4eae-85ba-a0f3e2f663ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0442770 Sep 03 11:35:12.310089 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-e33a71ab-679d-4346-abc4-15254f07004b service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863481 Sep 03 11:35:12.407606 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-51982338-14ad-46b1-a8ef-a9ae1122ef62 req-0c17518a-d54f-4407-869c-912484d5d1a5 service neutron] 10.222.0.11 "GET /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894554 Sep 03 11:35:13.276743 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c31b4fe9-7d23-4851-8f75-06ef695ec03f tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:13.278160 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c31b4fe9-7d23-4851-8f75-06ef695ec03f tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/networks?id=c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 200 len: 814 time: 0.1053455 Sep 03 11:35:13.293772 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-48408095-6815-4ee7-a53f-ebe3806a4f59 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/quotas/2dcf476cde84427596b9b0192490da69 HTTP/1.1" status: 200 len: 375 time: 0.0099361 Sep 03 11:35:13.329326 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-3377919b-de75-4b83-aede-f7d77affca0e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0304847 Sep 03 11:35:13.472189 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-1244f383-324b-44fb-bd9e-11ec13955381 service neutron] 10.222.0.16 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1344919 Sep 03 11:35:13.568260 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-1881520d-88ee-4fc2-b720-27ca43473f1c service neutron] 10.222.0.16 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892155 Sep 03 11:35:13.764641 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:13.939174 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8f165c70-e1b4-4628-b7e2-99710e435f5f req-d0c4cb5e-255b-4a94-977c-63d0fd312aac tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 210 time: 0.0786397 Sep 03 11:35:15.038207 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9615136b-75f7-4d35-abc3-06ae57514b94 req-b23ce563-5762-4a71-a9c5-6ee39740906e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 210 time: 0.0292134 Sep 03 11:35:15.981120 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-8c00153e-c9aa-4b9c-9580-77ba3280c329 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:15.982610 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-8c00153e-c9aa-4b9c-9580-77ba3280c329 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "GET /v2.0/networks?id=c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 200 len: 814 time: 0.1072426 Sep 03 11:35:15.996845 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Request body: {'port': {'device_id': '3075f124-4e98-4e4b-b775-90ed7199d139', 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1', 'admin_state_up': True, 'tenant_id': '2dcf476cde84427596b9b0192490da69'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:16.137391 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2a79650c-a585-42ed-90c2-61d10fdcb47b req-9d475a0a-2812-4bc6-8bf8-82645d5da548 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 210 time: 0.0265977 Sep 03 11:35:16.209951 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Made reservation on behalf of 2dcf476cde84427596b9b0192490da69 for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:35:16.213573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:16.346020 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Allocated IP 172.20.0.2 (c725f14d-842c-445d-9fae-44b313e242c1/cb7916f5-99f8-402c-b4ad-af12c8ae4adb/651dca67-4d21-4032-8b75-d461b8392ee2) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:16.504916 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:16.599504 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:16.645699 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Network c725f14d-842c-445d-9fae-44b313e242c1 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:16.648877 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:16.652591 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:16.681458 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Pushing event updated for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:16.710382 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:16.711034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:16.805476 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-c2eee594-a0ec-4f7a-bc26-7fe9d2fc2f17 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8124635 Sep 03 11:35:16.820108 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Request body: {'port': {'device_id': '3075f124-4e98-4e4b-b775-90ed7199d139', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:16.875677 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.145406 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 651dca67-4d21-4032-8b75-d461b8392ee2 {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:35:17.152717 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.165633 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Transition to ACTIVE for port object 651dca67-4d21-4032-8b75-d461b8392ee2 will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:17.250046 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.259061 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87c3ca5-7ad9-42b6-b506-b576d073da46 req-6daa536e-cfd4-4008-9d8b-a09ceb14f193 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:17.260640 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c87c3ca5-7ad9-42b6-b506-b576d073da46 req-6daa536e-cfd4-4008-9d8b-a09ceb14f193 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 931 time: 0.0519693 Sep 03 11:35:17.299933 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c87c3ca5-7ad9-42b6-b506-b576d073da46 req-68388f92-2972-4ce4-8e0c-e54eb1b8ef03 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333614 Sep 03 11:35:17.303172 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Pushing event updated for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:17.366715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Attempting to bind port 651dca67-4d21-4032-8b75-d461b8392ee2 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:17.367050 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Attempting to bind port 651dca67-4d21-4032-8b75-d461b8392ee2 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:17.367375 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Attempting to bind port 651dca67-4d21-4032-8b75-d461b8392ee2 on network c725f14d-842c-445d-9fae-44b313e242c1 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:17.372030 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Port 651dca67-4d21-4032-8b75-d461b8392ee2 on network c725f14d-842c-445d-9fae-44b313e242c1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:35:17.372351 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Attempting to bind port 651dca67-4d21-4032-8b75-d461b8392ee2 on network c725f14d-842c-445d-9fae-44b313e242c1 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:17.377190 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 35, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:17.377521 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Checking segment: {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:17.377901 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Bound using segment: {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:17.378317 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Bound port: 651dca67-4d21-4032-8b75-d461b8392ee2, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:17.378699 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.445480 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:17.448535 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=651dca67-4d21-4032-8b75-d461b8392ee2,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:17.530512 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.568494 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:17.569135 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:17.570549 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] 10.222.0.11 "PUT /v2.0/ports/651dca67-4d21-4032-8b75-d461b8392ee2 HTTP/1.1" status: 200 len: 1093 time: 0.7557576 Sep 03 11:35:17.570986 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:17.573224 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8852d573-3a7a-4a6d-8721-25265f9b6fb5" -d '{"events": [{"name": "network-changed", "server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:17.597547 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a721d5f2-c764-4dab-983e-f6c5e78c54ad service neutron] Pushing event updated for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:17.679101 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9fcba080-75af-49fe-8e8c-6458ea16951e x-openstack-request-id: req-9fcba080-75af-49fe-8e8c-6458ea16951e {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:17.679413 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:17.679614 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-9fcba080-75af-49fe-8e8c-6458ea16951e {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:17.680007 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2', 'status': 'completed', 'code': 200} Sep 03 11:35:17.736072 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-d6828848-0de9-48e2-b595-401258b5fdae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:17.737583 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-d6828848-0de9-48e2-b595-401258b5fdae service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 1096 time: 0.0441985 Sep 03 11:35:17.784810 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-92d06d1f-2c48-4d70-a32d-33b01c1d5683 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=651dca67-4d21-4032-8b75-d461b8392ee2 HTTP/1.1" status: 200 len: 217 time: 0.0373833 Sep 03 11:35:17.838453 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3259d002-05e3-462f-a01c-efb700cfd71f req-47bc24f6-2400-44dd-9ae7-355eac1887c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:17.839937 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-47bc24f6-2400-44dd-9ae7-355eac1887c8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=cb7916f5-99f8-402c-b4ad-af12c8ae4adb HTTP/1.1" status: 200 len: 854 time: 0.0469928 Sep 03 11:35:17.878207 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-abfe9c98-f4c8-4952-a3b5-8c09825ab23c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c725f14d-842c-445d-9fae-44b313e242c1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245543 Sep 03 11:35:17.979506 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-984e96ad-4f5d-467f-a771-a15c448f3eaf service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0892260 Sep 03 11:35:18.077556 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-3259d002-05e3-462f-a01c-efb700cfd71f req-79d3bd10-2cbd-4106-9b66-e3086a282840 service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904808 Sep 03 11:35:18.220375 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-559839be-dfcf-445b-82e6-8544733ff46e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:18.221866 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-559839be-dfcf-445b-82e6-8544733ff46e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 1096 time: 0.0423527 Sep 03 11:35:18.316552 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-f453835a-5ab2-4a3b-a373-48e438c5acef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:18.317930 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-f453835a-5ab2-4a3b-a373-48e438c5acef service neutron] 10.222.0.11 "GET /v2.0/networks?id=c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 200 len: 915 time: 0.0881155 Sep 03 11:35:18.363872 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-9df352d0-e8d6-4861-8bf7-99a349297e04 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=651dca67-4d21-4032-8b75-d461b8392ee2 HTTP/1.1" status: 200 len: 217 time: 0.0349617 Sep 03 11:35:18.426479 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-d87aa044-4436-49e2-9841-334971232f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:18.428096 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-d87aa044-4436-49e2-9841-334971232f36 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=cb7916f5-99f8-402c-b4ad-af12c8ae4adb HTTP/1.1" status: 200 len: 854 time: 0.0548477 Sep 03 11:35:18.428584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df71eba4-bc0f-4a0c-9156-c47978f4d5c9 req-213c3c85-063f-4703-9aa5-2398b9b5e325 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:18.430068 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-df71eba4-bc0f-4a0c-9156-c47978f4d5c9 req-213c3c85-063f-4703-9aa5-2398b9b5e325 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 943 time: 0.0568249 Sep 03 11:35:18.466472 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-4871c8c6-c9e8-4cb7-bd1c-0f63a8fb7896 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c725f14d-842c-445d-9fae-44b313e242c1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273473 Sep 03 11:35:18.469867 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-df71eba4-bc0f-4a0c-9156-c47978f4d5c9 req-5608df9d-b435-4ee4-90de-857090d086f4 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338650 Sep 03 11:35:18.561886 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-e329bddc-9ed2-486b-86ca-bc79f8663ea6 service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867085 Sep 03 11:35:18.665812 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-8852d573-3a7a-4a6d-8721-25265f9b6fb5 req-1749270b-23ae-4503-bcb8-ad186c92922b service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949793 Sep 03 11:35:19.591340 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda97615-5ffd-4996-9359-2617918352d0 req-36587a9b-cb51-4a3d-ac51-8260d087e0aa tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:19.592903 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eda97615-5ffd-4996-9359-2617918352d0 req-36587a9b-cb51-4a3d-ac51-8260d087e0aa tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 943 time: 0.0503879 Sep 03 11:35:19.637877 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eda97615-5ffd-4996-9359-2617918352d0 req-22bcceb7-4f16-47fd-9f29-360f51ddc3cb tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381012 Sep 03 11:35:20.540768 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 651dca67-4d21-4032-8b75-d461b8392ee2 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:35:20.659422 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=651dca67-4d21-4032-8b75-d461b8392ee2,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:20.675929 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '651dca67-4d21-4032-8b75-d461b8392ee2', 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1', 'port_id': '651dca67-4d21-4032-8b75-d461b8392ee2', 'mac_address': 'fa:16:3e:6b:23:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb7916f5-99f8-402c-b4ad-af12c8ae4adb', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:35:20.723365 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:20.739750 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 651dca67-4d21-4032-8b75-d461b8392ee2 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:35:20.771751 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=651dca67-4d21-4032-8b75-d461b8392ee2,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:20.783217 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d12664-3f58-4c7c-b3e0-f2c810b29eb8 req-95574a37-d2ad-4d9a-bf56-78b9f1133b1e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:20.784146 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f7d12664-3f58-4c7c-b3e0-f2c810b29eb8 req-95574a37-d2ad-4d9a-bf56-78b9f1133b1e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 943 time: 0.0607450 Sep 03 11:35:20.828031 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f7d12664-3f58-4c7c-b3e0-f2c810b29eb8 req-d74aeed0-347d-4318-a0ff-90a3c72fff46 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0364759 Sep 03 11:35:20.831081 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:20.913992 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:21.069889 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['651dca67-4d21-4032-8b75-d461b8392ee2'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:35:21.952745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526ff8c1-d913-497b-8dac-0dc61a1de936 req-db864911-2f2f-4b14-80cb-89d0af4cbcb7 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:21.955525 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-526ff8c1-d913-497b-8dac-0dc61a1de936 req-db864911-2f2f-4b14-80cb-89d0af4cbcb7 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 944 time: 0.0552480 Sep 03 11:35:21.998482 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-526ff8c1-d913-497b-8dac-0dc61a1de936 req-89875d1f-9add-457d-a4b6-76aa7c7dc95f tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354099 Sep 03 11:35:22.562596 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 651dca67-4d21-4032-8b75-d461b8392ee2 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:22.667049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 651dca67-4d21-4032-8b75-d461b8392ee2 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:22.671137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 651dca67-4d21-4032-8b75-d461b8392ee2 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:22.671508 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:22.754668 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:22.776393 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:22.778635 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccc911cc-ce78-4052-91f2-c8830986400e" -d '{"events": [{"server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "name": "network-vif-plugged", "status": "completed", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:22.791453 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=651dca67-4d21-4032-8b75-d461b8392ee2,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:22.814089 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4eb5eb51-e9c6-4ca9-a5e0-a542e39df4d7 x-openstack-request-id: req-4eb5eb51-e9c6-4ca9-a5e0-a542e39df4d7 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:22.814089 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "name": "network-vif-plugged", "status": "completed", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:22.814089 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-4eb5eb51-e9c6-4ca9-a5e0-a542e39df4d7 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:22.814089 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2', 'code': 200} Sep 03 11:35:22.856043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:22.903039 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:23.107183 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c253d39-20ff-4039-9a66-9e3570424401 req-d3b9d2eb-2f31-412c-850a-82ec84e3e7fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:23.108759 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-0c253d39-20ff-4039-9a66-9e3570424401 req-d3b9d2eb-2f31-412c-850a-82ec84e3e7fc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 1098 time: 0.0448067 Sep 03 11:35:23.120585 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce3be50-bc4a-4aa5-8c19-88250ecddb55 req-625d7dbb-78ba-413c-b980-6c6a65ab7524 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:23.122084 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fce3be50-bc4a-4aa5-8c19-88250ecddb55 req-625d7dbb-78ba-413c-b980-6c6a65ab7524 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0536540 Sep 03 11:35:23.149041 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-0c253d39-20ff-4039-9a66-9e3570424401 req-583f6000-83f1-4d74-87d5-aa7bed1daa06 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0287356 Sep 03 11:35:23.162171 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fce3be50-bc4a-4aa5-8c19-88250ecddb55 req-b5bc22ea-9c85-48f3-af3b-a4cb71cc39ab tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338485 Sep 03 11:35:23.701640 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-dd43acaa-392f-4b80-8a4c-ac33b72750ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:24.276590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817c33b6-9aed-400b-9cd9-66b24885dc68 req-c837a5c0-58fe-43f7-92ef-790681ad61cc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:24.278213 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-817c33b6-9aed-400b-9cd9-66b24885dc68 req-c837a5c0-58fe-43f7-92ef-790681ad61cc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0491016 Sep 03 11:35:24.317083 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-817c33b6-9aed-400b-9cd9-66b24885dc68 req-45cbddd5-3e88-4ddc-ad9a-e58a537c2bbd tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324476 Sep 03 11:35:24.949011 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:35:25.432875 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c60582-6093-43e9-8d87-47e94005c72c req-835ca8e7-fdac-4206-9257-e5bd1a36f885 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:25.434343 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-31c60582-6093-43e9-8d87-47e94005c72c req-835ca8e7-fdac-4206-9257-e5bd1a36f885 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0514426 Sep 03 11:35:25.472675 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-31c60582-6093-43e9-8d87-47e94005c72c req-b56e08e4-0c55-469a-b9d8-376e00266876 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320385 Sep 03 11:35:26.324159 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-07828e15-b1b2-4936-88cb-462adb13d20a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:26.722805 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:27.354357 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-ec0d32a5-ce7d-4ee5-90bd-e87567c26f73 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1629297831&fields=id&tenant_id=f29a932166fe443d8e6a5014f9de527d HTTP/1.1" status: 200 len: 267 time: 0.0333099 Sep 03 11:35:27.466887 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-89ea4ac7-6f76-4b44-9895-876982a49a30 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:27.468463 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-89ea4ac7-6f76-4b44-9895-876982a49a30 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 808 time: 0.1075671 Sep 03 11:35:27.484394 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-74ae6f08-f76a-4c7c-aa6b-a0adb51c44aa tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/quotas/f29a932166fe443d8e6a5014f9de527d HTTP/1.1" status: 200 len: 375 time: 0.0093975 Sep 03 11:35:27.541354 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-0611af70-ba78-4f2f-aad0-bf4510d69e9f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0505095 Sep 03 11:35:27.641046 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-cc84a1a0-cad4-45f8-afff-406dee556050 service neutron] 10.222.0.16 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871525 Sep 03 11:35:27.662343 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:27.735955 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-8cfe3da8-4f9c-4520-b546-a78bf849d6c6 service neutron] 10.222.0.16 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887098 Sep 03 11:35:28.342204 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ee5352e3-087e-4b60-80e7-ef23cdc7025d req-24456c52-f11b-4fa5-91e3-184634e8a644 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 210 time: 0.0275574 Sep 03 11:35:29.070892 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:29.435954 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-88cbe488-63ce-488b-8630-76ef9c940d66 req-8de1b3f2-ed42-4c9a-9a77-785ccdae6a47 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 210 time: 0.0272262 Sep 03 11:35:30.362954 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-1bcf8097-263a-4cff-a89b-5793f56c9be2 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:30.365443 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-1bcf8097-263a-4cff-a89b-5793f56c9be2 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 808 time: 0.1098435 Sep 03 11:35:30.411508 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-36daefaf-238f-4e5a-95fe-48c110a18ca9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f29a932166fe443d8e6a5014f9de527d HTTP/1.1" status: 200 len: 380 time: 0.0348582 Sep 03 11:35:30.420878 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'port': {'device_id': '829a3752-edd7-40cd-a072-7a508aacc20b', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'admin_state_up': True, 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'security_groups': ['0e7519ce-2af0-4317-9c10-6924af52ed89']}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:30.540523 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fb3285a5-1ebc-4de3-bff9-b82e936d7fdf req-f6287814-ae20-4772-baae-16a18970a040 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 210 time: 0.0309744 Sep 03 11:35:30.616175 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Made reservation on behalf of f29a932166fe443d8e6a5014f9de527d for: {'port': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:35:30.620716 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:30.750572 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Allocated IP 172.20.0.10 (a673d589-6e7c-4ca2-8a0c-89d350ececf8/610178de-2f3b-4c7b-a5c7-46ef7f74ed76/f6f00829-c3b2-4786-8501-3542b436780c) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:30.895669 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:30.914698 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Transition to ACTIVE for port object f6f00829-c3b2-4786-8501-3542b436780c will not be triggered until provisioned by entity DHCP. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:31.090577 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.133921 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:31.136936 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:31.140668 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:31.171068 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:31.202589 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:31.203170 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.281192 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-c4c2549b-fcb7-4f4b-90f1-02ad86aece9a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8607848 Sep 03 11:35:31.290863 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Request body: {'port': {'device_id': '829a3752-edd7-40cd-a072-7a508aacc20b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:31.352164 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.427999 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d1f2dacc-95d0-4a86-89f1-1af441c47bc5 None None] Provisioning for port f6f00829-c3b2-4786-8501-3542b436780c completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:31.432870 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d1f2dacc-95d0-4a86-89f1-1af441c47bc5 None None] Provisioning complete for port f6f00829-c3b2-4786-8501-3542b436780c triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:31.433237 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d1f2dacc-95d0-4a86-89f1-1af441c47bc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.469061 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-d1f2dacc-95d0-4a86-89f1-1af441c47bc5 None None] Port f6f00829-c3b2-4786-8501-3542b436780c cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:35:31.640382 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6f00829-c3b2-4786-8501-3542b436780c {{(pid=94432) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:35:31.649619 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.663274 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.provisioning_blocks [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Transition to ACTIVE for port object f6f00829-c3b2-4786-8501-3542b436780c will not be triggered until provisioned by entity L2. {{(pid=94432) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:35:31.677430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f8693e-1a6f-41a2-9818-91796e83ab1a req-2208e305-6483-4f95-b144-3813d88ca1cd tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:31.680231 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72f8693e-1a6f-41a2-9818-91796e83ab1a req-2208e305-6483-4f95-b144-3813d88ca1cd tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 932 time: 0.0610061 Sep 03 11:35:31.722358 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-72f8693e-1a6f-41a2-9818-91796e83ab1a req-5726b0c4-38d7-4fc0-a503-380e78685659 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359716 Sep 03 11:35:31.753070 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.812826 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:31.882418 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Attempting to bind port f6f00829-c3b2-4786-8501-3542b436780c on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:35:31.882797 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Attempting to bind port f6f00829-c3b2-4786-8501-3542b436780c by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:35:31.883125 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Attempting to bind port f6f00829-c3b2-4786-8501-3542b436780c on network a673d589-6e7c-4ca2-8a0c-89d350ececf8 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:31.889220 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Port f6f00829-c3b2-4786-8501-3542b436780c on network a673d589-6e7c-4ca2-8a0c-89d350ececf8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:35:31.889622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Attempting to bind port f6f00829-c3b2-4786-8501-3542b436780c on network a673d589-6e7c-4ca2-8a0c-89d350ececf8 {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:35:31.897729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 35, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:35:31.898215 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Checking segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:35:31.898646 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Bound using segment: {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'} {{(pid=94432) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:35:31.899081 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.managers [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Bound port: f6f00829-c3b2-4786-8501-3542b436780c, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 397, 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8'}}] {{(pid=94432) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:35:31.899441 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:31.968762 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, cleared binding levels {{(pid=94432) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:35:31.971758 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94432) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:35:32.068877 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:32.108196 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.108816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:32.110193 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] 10.222.0.11 "PUT /v2.0/ports/f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 1094 time: 0.8236609 Sep 03 11:35:32.110654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:32.112913 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d35053db-0409-44ce-84e3-c195f82ec66a" -d '{"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:32.148164 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5899cb92-ba2e-4f62-b574-eafe6b8b8902 service neutron] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=3']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:32.169553 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17764b66-f93d-4725-a74d-3ed3386293c5 x-openstack-request-id: req-17764b66-f93d-4725-a74d-3ed3386293c5 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:32.169839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:32.170088 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-17764b66-f93d-4725-a74d-3ed3386293c5 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:32.170515 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'status': 'completed', 'code': 200} Sep 03 11:35:32.238478 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35053db-0409-44ce-84e3-c195f82ec66a req-4694a7ae-8bc0-4275-a773-68e3e7b9d7d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.240426 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d35053db-0409-44ce-84e3-c195f82ec66a req-4694a7ae-8bc0-4275-a773-68e3e7b9d7d1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1097 time: 0.0474458 Sep 03 11:35:32.346666 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35053db-0409-44ce-84e3-c195f82ec66a req-8f35b2f8-638c-45af-b136-669a80a82965 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.348186 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d35053db-0409-44ce-84e3-c195f82ec66a req-8f35b2f8-638c-45af-b136-669a80a82965 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=f29a932166fe443d8e6a5014f9de527d&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0987322 Sep 03 11:35:32.450595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d35053db-0409-44ce-84e3-c195f82ec66a req-235314ef-945c-4c2c-9875-801aeaa1f186 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.452071 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d35053db-0409-44ce-84e3-c195f82ec66a req-235314ef-945c-4c2c-9875-801aeaa1f186 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0959876 Sep 03 11:35:32.538191 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-19353974-90d4-4d61-9297-45b4aa1031ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.539749 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-19353974-90d4-4d61-9297-45b4aa1031ce service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1097 time: 0.0413153 Sep 03 11:35:32.586210 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-93483f08-5335-4804-8133-e83157371cf0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 217 time: 0.0368063 Sep 03 11:35:32.646812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-bc5c0d88-f07a-4b94-bde8-2dc4196b844f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.648343 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-bc5c0d88-f07a-4b94-bde8-2dc4196b844f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0456181 Sep 03 11:35:32.697542 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-964c1938-cb95-46f4-9104-3f914abafde8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.699101 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-964c1938-cb95-46f4-9104-3f914abafde8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417459 Sep 03 11:35:32.793458 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-d6da5a84-7e8c-4e7f-bd5c-1b2c5474f4a7 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867870 Sep 03 11:35:32.848283 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b06b1b-1ae0-42ee-bd38-15494aa4d1bf req-9ca02ed8-218c-48e0-a45b-d96a01c8b38f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:32.850062 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-20b06b1b-1ae0-42ee-bd38-15494aa4d1bf req-9ca02ed8-218c-48e0-a45b-d96a01c8b38f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0509062 Sep 03 11:35:32.891096 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-20b06b1b-1ae0-42ee-bd38-15494aa4d1bf req-8f367adc-5187-4f47-a6ec-0fcd81a05d49 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349476 Sep 03 11:35:32.892346 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-fafc5bb9-0a08-4d35-9a17-629a38b9b335 req-5b2ccac6-e4e8-4670-afb7-a55c90db3890 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912783 Sep 03 11:35:34.009003 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fb90ff-f8ad-4043-a67c-32eb0f45bedd req-47c4a1eb-e917-481d-967e-2b66b80a56cf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:34.010499 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a9fb90ff-f8ad-4043-a67c-32eb0f45bedd req-47c4a1eb-e917-481d-967e-2b66b80a56cf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0490274 Sep 03 11:35:34.049973 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a9fb90ff-f8ad-4043-a67c-32eb0f45bedd req-13fd20a2-c991-4b58-b3d1-d1de920ff6a0 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336652 Sep 03 11:35:35.166737 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b5bd93-b834-4b51-8a8e-1b078dc7ea95 req-d5396095-a8e6-4b39-9b55-2fc40e91c768 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:35.168231 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12b5bd93-b834-4b51-8a8e-1b078dc7ea95 req-d5396095-a8e6-4b39-9b55-2fc40e91c768 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0517905 Sep 03 11:35:35.208512 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12b5bd93-b834-4b51-8a8e-1b078dc7ea95 req-1122a303-dd6b-4ede-aee0-3f976462dc34 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344310 Sep 03 11:35:36.326993 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f73a9f2-bdad-4bbe-b41d-4b96a9ff189b req-7572f5b6-e6ff-4e4f-a3a3-52d9af5fea1a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:36.328466 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3f73a9f2-bdad-4bbe-b41d-4b96a9ff189b req-7572f5b6-e6ff-4e4f-a3a3-52d9af5fea1a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0506830 Sep 03 11:35:36.369602 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3f73a9f2-bdad-4bbe-b41d-4b96a9ff189b req-0816a236-bdfb-41ff-b718-ddd142c18a5f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345433 Sep 03 11:35:37.486960 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4159d2b8-f69e-49e1-9f5a-a3a2d709b246 req-1f2a5763-dc1a-481e-bf25-61d42a5c578d tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:37.489256 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4159d2b8-f69e-49e1-9f5a-a3a2d709b246 req-1f2a5763-dc1a-481e-bf25-61d42a5c578d tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0525904 Sep 03 11:35:37.529732 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4159d2b8-f69e-49e1-9f5a-a3a2d709b246 req-9c437119-9fd8-4f05-b2e0-80dd0ece3804 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344288 Sep 03 11:35:38.650581 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27ba14af-cd1b-473c-80b2-939f20407e3c req-a4d1073b-3fb9-4943-b88b-c6dee10051d0 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:38.652086 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-27ba14af-cd1b-473c-80b2-939f20407e3c req-a4d1073b-3fb9-4943-b88b-c6dee10051d0 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0535934 Sep 03 11:35:38.695256 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-27ba14af-cd1b-473c-80b2-939f20407e3c req-c5675719-be37-4d69-abab-4bd8652bc937 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343192 Sep 03 11:35:39.807764 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b732b8-38d5-4f1d-8cc6-40e281b52601 req-f260437a-3300-4624-8871-831b1a97ea20 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:39.809258 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b6b732b8-38d5-4f1d-8cc6-40e281b52601 req-f260437a-3300-4624-8871-831b1a97ea20 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0483420 Sep 03 11:35:39.853795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b6b732b8-38d5-4f1d-8cc6-40e281b52601 req-cc351070-c475-42f5-8cca-c25f7a6d6cfd tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382540 Sep 03 11:35:40.672547 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:35:40.773718 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:40.784689 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'f6f00829-c3b2-4786-8501-3542b436780c', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'mac_address': 'fa:16:3e:f9:c0:ca', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 397, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:35:40.826423 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:40.839446 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6f00829-c3b2-4786-8501-3542b436780c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:35:40.862423 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:40.979022 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:40.981601 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef15fd58-7435-4c0c-8db9-52adcf1d6ef0 req-0cb5bba8-1e5d-4889-b64a-708614a56275 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:40.983185 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef15fd58-7435-4c0c-8db9-52adcf1d6ef0 req-0cb5bba8-1e5d-4889-b64a-708614a56275 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0817842 Sep 03 11:35:40.996550 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc293684-79ec-4c52-9af9-11ab6c175339 req-1884cf1c-78c7-47b0-afae-3b507241d78c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:40.998028 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cc293684-79ec-4c52-9af9-11ab6c175339 req-1884cf1c-78c7-47b0-afae-3b507241d78c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0707219 Sep 03 11:35:41.030027 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:41.036960 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.038309 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.038699 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.039041 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.039375 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.039717 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.040034 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.040418 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.040692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.041015 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.041338 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.041659 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:41.055874 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ef15fd58-7435-4c0c-8db9-52adcf1d6ef0 req-1eba080a-5c4a-47c8-b8b8-a973617f86ea tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568719 Sep 03 11:35:41.060696 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cc293684-79ec-4c52-9af9-11ab6c175339 req-7ec0d996-c6d9-401f-9f5c-961efb050d13 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484455 Sep 03 11:35:41.343456 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f6f00829-c3b2-4786-8501-3542b436780c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:35:42.210260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a474fe0-ae4c-4e14-b403-904af07f3218 req-707bef97-be2f-44a3-a502-5ff4f1e4acc9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:42.211775 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1a474fe0-ae4c-4e14-b403-904af07f3218 req-707bef97-be2f-44a3-a502-5ff4f1e4acc9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0817750 Sep 03 11:35:42.219727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0509b797-cf9b-48f0-8e1f-6df50356db9a req-90475e5c-73ac-40f4-8f4a-0cb0b2b31314 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:42.221079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0509b797-cf9b-48f0-8e1f-6df50356db9a req-90475e5c-73ac-40f4-8f4a-0cb0b2b31314 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 945 time: 0.0822575 Sep 03 11:35:42.275854 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1a474fe0-ae4c-4e14-b403-904af07f3218 req-e9e69682-a607-4e31-8e79-93fdb0a65f1f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538416 Sep 03 11:35:42.282869 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0509b797-cf9b-48f0-8e1f-6df50356db9a req-253b32be-6c8b-4136-94f0-09e5a32593b6 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546093 Sep 03 11:35:42.690205 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:35:42.804944 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port f6f00829-c3b2-4786-8501-3542b436780c completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:35:42.808987 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port f6f00829-c3b2-4786-8501-3542b436780c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:35:42.809355 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:43.023599 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:43.045511 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:43.047868 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2d57f49-52e1-4436-878b-2d71337cc2ec" -d '{"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-plugged", "status": "completed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:43.060622 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:43.141230 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e49c804e-7ec3-4de7-9043-06a680acbb27 x-openstack-request-id: req-e49c804e-7ec3-4de7-9043-06a680acbb27 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:43.141508 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-plugged", "status": "completed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:43.141757 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e49c804e-7ec3-4de7-9043-06a680acbb27 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:43.142141 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'code': 200} Sep 03 11:35:43.147225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:43.198213 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:43.436590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a02670f-e5c3-45b9-b90e-adc2d347ee35 req-7b1f5229-dd3d-424c-80f9-afc8a44d179a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:43.438160 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5a02670f-e5c3-45b9-b90e-adc2d347ee35 req-7b1f5229-dd3d-424c-80f9-afc8a44d179a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0832374 Sep 03 11:35:43.446138 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89c0057-1769-4084-8aa5-1991cd4753b7 req-bce0f20c-b8f8-49f9-a5c6-8d80b4226092 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:43.447551 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e89c0057-1769-4084-8aa5-1991cd4753b7 req-bce0f20c-b8f8-49f9-a5c6-8d80b4226092 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0906072 Sep 03 11:35:43.504807 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5a02670f-e5c3-45b9-b90e-adc2d347ee35 req-453b1437-6f4b-4acc-979d-982641602614 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563009 Sep 03 11:35:43.510260 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e89c0057-1769-4084-8aa5-1991cd4753b7 req-d85e03ea-0f09-4715-98d7-a83795cf3598 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554094 Sep 03 11:35:43.717888 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383a0710-0f35-4d5c-86e2-093d6d6f0ee0 req-16316c10-3583-4b41-b3b7-822376f28cce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:43.719452 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-383a0710-0f35-4d5c-86e2-093d6d6f0ee0 req-16316c10-3583-4b41-b3b7-822376f28cce service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1099 time: 0.0448799 Sep 03 11:35:43.755781 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-383a0710-0f35-4d5c-86e2-093d6d6f0ee0 req-c5b3a2b9-f5e2-4739-82c4-7c15bd3e2578 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0277591 Sep 03 11:35:43.767743 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:44.628532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82c8c1b-18b7-4f8a-bba5-968ab8ff2963 req-1927aed8-633f-48bb-88e3-967156b6f8de tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:44.630089 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e82c8c1b-18b7-4f8a-bba5-968ab8ff2963 req-1927aed8-633f-48bb-88e3-967156b6f8de tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0525825 Sep 03 11:35:44.668517 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e82c8c1b-18b7-4f8a-bba5-968ab8ff2963 req-81831b7a-306c-4d64-aa00-a00630396509 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317783 Sep 03 11:35:44.777424 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6aa3d9-a9f2-41b8-a864-d3791718b0e4 req-a5d5393c-e4ec-4627-8b77-74de840913fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:44.780506 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7d6aa3d9-a9f2-41b8-a864-d3791718b0e4 req-a5d5393c-e4ec-4627-8b77-74de840913fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0506902 Sep 03 11:35:44.822356 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7d6aa3d9-a9f2-41b8-a864-d3791718b0e4 req-c3c67fbe-df89-4d7a-99c7-721af900b9b0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374458 Sep 03 11:35:45.781194 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8b70e3-09be-4bb3-9dff-43917380b03b req-706fb7ff-ffe4-4b81-9f27-ec2a1551d96b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:45.782613 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e8b70e3-09be-4bb3-9dff-43917380b03b req-706fb7ff-ffe4-4b81-9f27-ec2a1551d96b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0483727 Sep 03 11:35:45.821331 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e8b70e3-09be-4bb3-9dff-43917380b03b req-8b871745-12d9-4f41-8239-6f4d0149b24a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327919 Sep 03 11:35:45.940102 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be72ad54-3e01-4778-9e52-9c9cabf1e6ce req-82c7e9f4-80db-490c-9451-5f464549af2b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:45.941604 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be72ad54-3e01-4778-9e52-9c9cabf1e6ce req-82c7e9f4-80db-490c-9451-5f464549af2b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0536993 Sep 03 11:35:45.981676 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be72ad54-3e01-4778-9e52-9c9cabf1e6ce req-a242aac4-759a-4413-9c08-bd05b5be6c05 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332062 Sep 03 11:35:46.003149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38526) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:46.089980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874e6ae6-485e-4ad2-94af-dc263d629257 req-f9a1acef-b1c4-4d4a-9130-48cc56488c11 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:46.091658 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-874e6ae6-485e-4ad2-94af-dc263d629257 req-f9a1acef-b1c4-4d4a-9130-48cc56488c11 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0558250 Sep 03 11:35:46.150679 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4299e753-7f30-4e0b-8464-bb6d0b9587b7 tempest-TestShelveInstance-37222877 tempest-TestShelveInstance-37222877-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:46.152255 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-4299e753-7f30-4e0b-8464-bb6d0b9587b7 tempest-TestShelveInstance-37222877 tempest-TestShelveInstance-37222877-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1094 time: 0.1479869 Sep 03 11:35:46.155251 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38532) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:46.159675 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'fixed_ip_address': '172.20.0.10'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:35:46.160638 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-874e6ae6-485e-4ad2-94af-dc263d629257 req-0301665f-c1fb-4c4b-a1de-aaf1b9de61e4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607712 Sep 03 11:35:46.173242 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe764416-cce1-4a7a-adda-eabee0e9025c req-d22afd8c-c730-43a5-96b1-9c73eee373d1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:46.176408 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fe764416-cce1-4a7a-adda-eabee0e9025c req-d22afd8c-c730-43a5-96b1-9c73eee373d1 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0777342 Sep 03 11:35:46.227329 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fe764416-cce1-4a7a-adda-eabee0e9025c req-c1f15c9e-595f-444d-bb7e-a408aadb35ec tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0364180 Sep 03 11:35:46.255531 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for floatingip, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:46.352149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:46.453383 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Allocated IP 172.27.0.111 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/57964a84-930f-4f57-ab2d-9ac103b74ed0) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:35:46.555334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:46.655683 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:46.689844 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:35:46.692694 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:35:46.697550 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:35:46.733373 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'Port': ['ID=57964a84-930f-4f57-ab2d-9ac103b74ed0,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:47.287647 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec8bac4-3968-4ea8-aca5-0bc59c973f43 req-61eccc8d-1b20-451f-8825-16e81d0c4abb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:47.289929 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6ec8bac4-3968-4ea8-aca5-0bc59c973f43 req-61eccc8d-1b20-451f-8825-16e81d0c4abb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0542331 Sep 03 11:35:47.304397 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:47.359484 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6ec8bac4-3968-4ea8-aca5-0bc59c973f43 req-90fd50e5-5a3b-4c0a-b1bf-3b41c0d19de5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0637236 Sep 03 11:35:47.374999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc89de3f-64b4-472c-b861-247a82b2b634 req-7afc14ff-acba-4250-ab66-3f5e473588f3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:47.376509 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fc89de3f-64b4-472c-b861-247a82b2b634 req-7afc14ff-acba-4250-ab66-3f5e473588f3 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0796275 Sep 03 11:35:47.414600 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fc89de3f-64b4-472c-b861-247a82b2b634 req-14f02d29-ae65-4ffe-bee9-9b0dbfafe113 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315011 Sep 03 11:35:47.429658 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:47.579745 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:47.637914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:47.707299 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event updated for resources: {'Port': ['ID=57964a84-930f-4f57-ab2d-9ac103b74ed0,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:47.719726 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:47.821301 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Floating IP 58874a23-6899-40ab-a4f4-2953efd341dd associated. External IP: 172.27.0.111, port: f6f00829-c3b2-4786-8501-3542b436780c. Sep 03 11:35:48.051006 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-e9188acc-e35f-4c4f-bd20-1ae730462c6c tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.052458 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-e9188acc-e35f-4c4f-bd20-1ae730462c6c tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0962901 Sep 03 11:35:48.089063 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Router 5de10b45-f5e8-4001-950d-d88a63808984 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:35:48.233805 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Deleting port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:35:48.234065 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.255212 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:35:48.265127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Sync routers for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:48.275238 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:48.275850 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:48.336135 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] For port f6ef2462-ac65-4a02-bbea-e6ca11e791b8, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:48.336135 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.380574 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:48.403404 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.482396 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-9b0ebbe8-8dec-43b8-86dd-3f086ae01a06 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.3158612 Sep 03 11:35:48.482396 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:48.482396 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34bd8d73-68a9-4f9f-ad91-802aeb57f819" -d '{"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:48.504259 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2c986a-94bf-4d3c-a145-0d10ceea7167 req-e1af9a45-bea8-4a77-8ae0-faf26aace824 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.506340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2c986a-94bf-4d3c-a145-0d10ceea7167 req-e1af9a45-bea8-4a77-8ae0-faf26aace824 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0708776 Sep 03 11:35:48.557831 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.558166 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.558524 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Floating IP a414cb49-435b-44a7-8439-e9ce5a4062ea disassociated. External IP: 172.27.0.99, port: f6ef2462-ac65-4a02-bbea-e6ca11e791b8. Sep 03 11:35:48.558992 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Calling delete_port for f6ef2462-ac65-4a02-bbea-e6ca11e791b8 owned by compute:nova {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:35:48.580531 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2c986a-94bf-4d3c-a145-0d10ceea7167 req-62298f8d-5159-489d-99a1-9ab718451568 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633199 Sep 03 11:35:48.589338 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61340bb9-7b3a-4ace-9606-e709bf87fe1e req-9de73ba9-f043-487b-b281-0aabae6ea509 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.591162 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61340bb9-7b3a-4ace-9606-e709bf87fe1e req-9de73ba9-f043-487b-b281-0aabae6ea509 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 945 time: 0.0841732 Sep 03 11:35:48.638908 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61340bb9-7b3a-4ace-9606-e709bf87fe1e req-3fd66b2e-4e31-4af6-8a8b-81c2dcd84b21 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups?id=2eaca3b8-7478-4a79-8cfe-3b140a605352&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411727 Sep 03 11:35:48.641474 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '58874a23-6899-40ab-a4f4-2953efd341dd', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'floating_ip_address': '172.27.0.111', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'mac_address': 'fa:16:3e:f9:c0:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '829a3752-edd7-40cd-a072-7a508aacc20b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:35:46Z', 'updated_at': '2021-09-03T11:35:46Z', 'revision_number': 0, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:48.669682 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Checking router: 5de10b45-f5e8-4001-950d-d88a63808984 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:48.676969 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29d7dc13-dabf-45ac-850e-b3153b61b041 x-openstack-request-id: req-29d7dc13-dabf-45ac-850e-b3153b61b041 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:48.677271 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:48.677766 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-29d7dc13-dabf-45ac-850e-b3153b61b041 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:48.678154 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'status': 'completed', 'code': 200} Sep 03 11:35:48.685791 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:48.686546 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:48.731382 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-cb58ba4a-6dae-4728-9933-5757686afe48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.732908 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-cb58ba4a-6dae-4728-9933-5757686afe48 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1099 time: 0.0430326 Sep 03 11:35:48.759586 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:48.789845 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'Port': ['ID=f6ef2462-ac65-4a02-bbea-e6ca11e791b8,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:48.802976 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:48.832564 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-8946c528-1851-4ee7-84b5-eddecf9b7123 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.834248 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-8946c528-1851-4ee7-84b5-eddecf9b7123 service neutron] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 909 time: 0.0944343 Sep 03 11:35:48.903693 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-e0f3eae0-1031-43b1-8c38-625a94684282 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 1000 time: 0.0611961 Sep 03 11:35:48.913286 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:35:48.954980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-60a425cd-5741-46b3-af52-3c614670f916 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:48.956586 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-60a425cd-5741-46b3-af52-3c614670f916 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0460107 Sep 03 11:35:49.009037 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-7dae1c00-3192-4031-baa0-90bcbe436984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:49.010709 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-7dae1c00-3192-4031-baa0-90bcbe436984 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0464149 Sep 03 11:35:49.029353 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:35:49.041767 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:49.063494 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:49.064401 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:49.066447 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '58874a23-6899-40ab-a4f4-2953efd341dd', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'floating_ip_address': '172.27.0.111', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'mac_address': 'fa:16:3e:f9:c0:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '829a3752-edd7-40cd-a072-7a508aacc20b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:35:46Z', 'updated_at': '2021-09-03T11:35:46Z', 'revision_number': 0, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:49.077889 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] No DVR routers for this DVR port f6ef2462-ac65-4a02-bbea-e6ca11e791b8 on host hv-cinder-76019 {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:35:49.080479 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:49.082815 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.11 "DELETE /v2.0/ports/f6ef2462-ac65-4a02-bbea-e6ca11e791b8 HTTP/1.1" status: 204 len: 173 time: 1.0220697 Sep 03 11:35:49.109361 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2e51bf4-9102-4f91-bcbc-497fb1bb16e2 None None] The sync data for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi is: [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': '58874a23-6899-40ab-a4f4-2953efd341dd', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'floating_ip_address': '172.27.0.111', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'mac_address': 'fa:16:3e:f9:c0:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '829a3752-edd7-40cd-a072-7a508aacc20b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:35:46Z', 'updated_at': '2021-09-03T11:35:46Z', 'revision_number': 0, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:35:49.117896 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-f283e458-cd44-4bef-ab6d-d2f242a4899d service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990949 Sep 03 11:35:49.211448 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:49.248356 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-34bd8d73-68a9-4f9f-ad91-802aeb57f819 req-b63a6981-f64d-4bfe-ba69-9e011175f8dd service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224973 Sep 03 11:35:49.436645 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:49.467340 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:49.475966 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:49.476579 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:49.584481 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:49.746898 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9b2f8af-5b60-4f50-9818-80694dfb8fc0 req-84925acb-e039-42b7-8442-f4d35a534891 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:49.749703 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9b2f8af-5b60-4f50-9818-80694dfb8fc0 req-84925acb-e039-42b7-8442-f4d35a534891 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0777411 Sep 03 11:35:49.777886 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f64493b7-0634-495d-a9bd-450562d10f46 req-52c90f2b-462f-411b-b6b6-1dbc1c9c821a tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/ports?device_id=8f10c833-a794-4338-8166-b83ab4e5a998 HTTP/1.1" status: 200 len: 210 time: 0.0481374 Sep 03 11:35:49.822842 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e9b2f8af-5b60-4f50-9818-80694dfb8fc0 req-b0351951-2710-48d0-a6b8-9c29e408e2ec tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526950 Sep 03 11:35:49.837800 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b139073-7a23-455d-ad28-fada35bdf614 None None] New status for floating IP 58874a23-6899-40ab-a4f4-2953efd341dd: ACTIVE {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:35:49.911184 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:49.937822 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30456a9b-b396-4e1d-8306-1ffcf558c944 None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:30:06Z', 'revision_number': 4, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '0fd6f549-43c3-4999-89d6-d452bf7f6126', 'name': '', 'network_id': '246bd34f-94aa-4eae-85ba-a0f3e2f663ce', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'mac_address': 'fa:16:3e:53:76:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_interface', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:04Z', 'updated_at': '2021-09-03T11:30:14Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'subnets': [{'id': 'd08fca75-5bf1-4f46-a3a4-8feca1cdbe2a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:35:50.166634 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8b3f7e9-e4ee-4765-ba7e-59adb13bf443 None None] New status for floating IP a414cb49-435b-44a7-8439-e9ce5a4062ea: DOWN {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:35:50.679853 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'name': 'network-vif-deleted', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:35:50.682247 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e0be9b6-219d-46e9-aa96-eeedb95a53fb" -d '{"events": [{"server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "name": "network-vif-deleted", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:35:50.717259 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:35:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c83fb9ff-4616-4d71-83f0-fb83e441de11 x-openstack-request-id: req-c83fb9ff-4616-4d71-83f0-fb83e441de11 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:35:50.717548 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f10c833-a794-4338-8166-b83ab4e5a998", "name": "network-vif-deleted", "tag": "f6ef2462-ac65-4a02-bbea-e6ca11e791b8", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:35:50.717799 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c83fb9ff-4616-4d71-83f0-fb83e441de11 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:35:50.718190 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f10c833-a794-4338-8166-b83ab4e5a998', 'name': 'network-vif-deleted', 'tag': 'f6ef2462-ac65-4a02-bbea-e6ca11e791b8', 'status': 'completed', 'code': 200} Sep 03 11:35:50.734641 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6ef2462-ac65-4a02-bbea-e6ca11e791b8 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:35:50.755098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: f6ef2462-ac65-4a02-bbea-e6ca11e791b8 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:35:50.755437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6ef2462-ac65-4a02-bbea-e6ca11e791b8 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:35:50.917596 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38566) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:50.951112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce4b320-a1e7-47fb-a700-5a8f6f43c921 req-4f9de8bc-c95c-486c-b2ea-62b40a81dc57 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:50.952648 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1ce4b320-a1e7-47fb-a700-5a8f6f43c921 req-4f9de8bc-c95c-486c-b2ea-62b40a81dc57 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0533121 Sep 03 11:35:50.973553 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:50.990648 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1ce4b320-a1e7-47fb-a700-5a8f6f43c921 req-1e952491-3bf2-4e8e-84b3-71b3713e7b67 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318542 Sep 03 11:35:51.000108 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.115985 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.118903 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.120112 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "DELETE /v2.0/security-groups/2eaca3b8-7478-4a79-8cfe-3b140a605352 HTTP/1.1" status: 204 len: 168 time: 0.2015617 Sep 03 11:35:51.122988 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38568) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:51.129508 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df1215f-11e1-42c7-8377-07b62883bdf0 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2eaca3b8-7478-4a79-8cfe-3b140a605352,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:51.136943 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.api.v2.resource [None req-aa0fd063-1383-4c1d-8647-639277921c03 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] show failed (client error): The resource could not be found. Sep 03 11:35:51.137950 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-aa0fd063-1383-4c1d-8647-639277921c03 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "GET /v2.0/security-groups/2eaca3b8-7478-4a79-8cfe-3b140a605352 HTTP/1.1" status: 404 len: 347 time: 0.0139651 Sep 03 11:35:51.140764 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38570) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:51.494506 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Deleting port 7d7446c3-754c-4c53-bde0-b23209b3ea0f {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:35:51.494767 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.569420 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.570275 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.581797 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Calling delete_port for 7d7446c3-754c-4c53-bde0-b23209b3ea0f owned by network:floatingip {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:35:51.807939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.838086 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Pushing event deleted for resources: {'Port': ['ID=7d7446c3-754c-4c53-bde0-b23209b3ea0f,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:51.865839 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.866190 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.867091 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.868024 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.868366 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.868703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.869040 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.869372 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.869703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.870049 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.870390 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.870717 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:35:51.911632 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks [] for floatingip, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.914770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:51.915940 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1335ab1c-d1f1-4282-a7ff-afb576797f5b tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] 10.222.0.16 "DELETE /v2.0/floatingips/a414cb49-435b-44a7-8439-e9ce5a4062ea HTTP/1.1" status: 204 len: 168 time: 0.7742169 Sep 03 11:35:52.114076 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048a9c31-e9aa-4a4f-8bd7-e2e4571ad50f req-a36f91fd-4ac7-4c67-ac10-e373d405531e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:52.115557 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-048a9c31-e9aa-4a4f-8bd7-e2e4571ad50f req-a36f91fd-4ac7-4c67-ac10-e373d405531e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0488825 Sep 03 11:35:52.154407 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-048a9c31-e9aa-4a4f-8bd7-e2e4571ad50f req-7f6c9348-9a70-495e-b632-221a5615e7a3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322204 Sep 03 11:35:53.280004 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf989eb-0f9e-4e29-b828-8727fe4de2dc req-a5d1d563-3226-471c-98f9-b9cc8182bdfb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:53.281496 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bcf989eb-0f9e-4e29-b828-8727fe4de2dc req-a5d1d563-3226-471c-98f9-b9cc8182bdfb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0486603 Sep 03 11:35:53.322975 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bcf989eb-0f9e-4e29-b828-8727fe4de2dc req-fd7869c0-5fd0-4855-a3f1-21f882b11488 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0355480 Sep 03 11:35:53.684242 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0ec9e4e8-0661-4bc5-9eb7-1e233e4d6017 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:54.438991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e097d16-dd3c-4b6e-8e28-72104d7754e3 req-e67b7997-65eb-4cc7-ae26-5fd60ca9d868 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:54.440703 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e097d16-dd3c-4b6e-8e28-72104d7754e3 req-e67b7997-65eb-4cc7-ae26-5fd60ca9d868 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0480959 Sep 03 11:35:54.479160 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3e097d16-dd3c-4b6e-8e28-72104d7754e3 req-1006c717-0f0b-4f4e-834b-6e42b03620a1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318458 Sep 03 11:35:55.597111 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5255639a-1acd-4929-972c-71c85c11f334 req-9f98dc98-2f1d-4fb3-930e-9187b4fff89f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:55.598624 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5255639a-1acd-4929-972c-71c85c11f334 req-9f98dc98-2f1d-4fb3-930e-9187b4fff89f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0487068 Sep 03 11:35:55.636469 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5255639a-1acd-4929-972c-71c85c11f334 req-df466f09-2aa8-460e-a67f-e59e00e66ddd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315633 Sep 03 11:35:56.335793 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5f3f9f7-11ab-4396-bc45-22e4399d90e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:56.704883 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:56.753413 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a840151f-7295-4421-869b-3f706a1d4e2c req-0dbbb2f3-2acb-482e-a361-e553685d4080 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:56.754905 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a840151f-7295-4421-869b-3f706a1d4e2c req-0dbbb2f3-2acb-482e-a361-e553685d4080 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0487957 Sep 03 11:35:56.800607 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a840151f-7295-4421-869b-3f706a1d4e2c req-5529f46c-dda7-4998-91ce-ea706b319777 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357945 Sep 03 11:35:57.670067 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:57.920973 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc73560-9c40-4455-ad1b-846e7e500576 req-48cff20d-5e2d-46f0-a78b-7789e2dfa0fa tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:57.922456 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1cc73560-9c40-4455-ad1b-846e7e500576 req-48cff20d-5e2d-46f0-a78b-7789e2dfa0fa tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0498953 Sep 03 11:35:57.961710 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1cc73560-9c40-4455-ad1b-846e7e500576 req-eab9c8d9-074e-403c-a835-3538f1c90221 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329168 Sep 03 11:35:58.030700 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38638) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:58.480303 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:58.769101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Deleting port 0fd6f549-43c3-4999-89d6-d452bf7f6126 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:35:58.769353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:58.845087 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] For port 0fd6f549-43c3-4999-89d6-d452bf7f6126, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0fd6f549-43c3-4999-89d6-d452bf7f6126,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:35:58.845442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:58.857786 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Calling delete_port for 0fd6f549-43c3-4999-89d6-d452bf7f6126 owned by network:router_interface {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:35:59.044025 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:59.083497 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e6de6a-3b1a-43dd-ad50-4c6d5b216286 req-fd3673b3-b0f5-437f-b49f-f46ef4ab03b7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:35:59.084949 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41e6de6a-3b1a-43dd-ad50-4c6d5b216286 req-fd3673b3-b0f5-437f-b49f-f46ef4ab03b7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0519955 Sep 03 11:35:59.100324 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:59.133041 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Pushing event deleted for resources: {'Port': ['ID=0fd6f549-43c3-4999-89d6-d452bf7f6126,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:35:59.171260 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-41e6de6a-3b1a-43dd-ad50-4c6d5b216286 req-815c0872-5c2c-492f-8927-013b827b2ac3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802243 Sep 03 11:35:59.311548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:59.516177 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Router cc10d27b-3874-4cbe-8b05-b1194e371752 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:35:59.618085 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:35:59.623314 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-58a41fae-23ec-4d28-8b13-e8efabf6cdfa admin admin] 10.222.0.16 "PUT /v2.0/routers/cc10d27b-3874-4cbe-8b05-b1194e371752/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5915518 Sep 03 11:35:59.625923 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38648) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:35:59.626951 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Sync routers for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:35:59.640189 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:59.640804 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:59.726294 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks [] for router, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:59.740642 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:35:59.828900 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:35:59.918892 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:35:58Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:35:59.944618 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Checking router: cc10d27b-3874-4cbe-8b05-b1194e371752 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:35:59.953507 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Routers {'cc10d27b-3874-4cbe-8b05-b1194e371752'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:35:59.954098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:35:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['cc10d27b-3874-4cbe-8b05-b1194e371752'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:36:00.056086 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] Set router cc10d27b-3874-4cbe-8b05-b1194e371752 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:36:00.069176 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Deleting port 5560cb35-25cc-4f08-87c3-68abb05c40aa {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:36:00.069511 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.122660 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:36:00.148555 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] For port 5560cb35-25cc-4f08-87c3-68abb05c40aa, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5560cb35-25cc-4f08-87c3-68abb05c40aa,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:00.149173 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.165234 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Calling delete_port for 5560cb35-25cc-4f08-87c3-68abb05c40aa owned by network:router_gateway {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:36:00.352130 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70130811-81ad-4045-9f5c-640691a7d5fb req-2600c0d8-0add-4b19-8525-ade0fa802943 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:00.353648 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-70130811-81ad-4045-9f5c-640691a7d5fb req-2600c0d8-0add-4b19-8525-ade0fa802943 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0908163 Sep 03 11:36:00.402005 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-70130811-81ad-4045-9f5c-640691a7d5fb req-133692ce-dafd-4745-bbdd-2b1f1890a899 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416732 Sep 03 11:36:00.431956 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:00.445987 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:36:00.472676 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.485296 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:35:58Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:36:00.501279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Pushing event deleted for resources: {'Port': ['ID=5560cb35-25cc-4f08-87c3-68abb05c40aa,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:00.518394 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-31ae0869-be1e-4529-81ef-859bc72f9a0c None None] The sync data for ids ['cc10d27b-3874-4cbe-8b05-b1194e371752'] in dv-cinder-760199-12-iscsi is: [{'id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'name': 'tempest-AttachVolumeTestJSON-63040892-router', 'tenant_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234'}], 'enable_snat': True}, 'gw_port_id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:30:00Z', 'updated_at': '2021-09-03T11:35:58Z', 'revision_number': 5, 'project_id': '8e0bcf21f2dd49fe9f29d6892da5d5cc', 'gw_port': {'id': '5560cb35-25cc-4f08-87c3-68abb05c40aa', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ac:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc10d27b-3874-4cbe-8b05-b1194e371752', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.234', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:30:01Z', 'updated_at': '2021-09-03T11:30:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:36:00.520940 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.535711 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:36:00.557937 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:00.570115 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.638217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.687595 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=6']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:00.912746 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:00.915949 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.001491 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0fd6f549-43c3-4999-89d6-d452bf7f6126 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:36:01.021373 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 0fd6f549-43c3-4999-89d6-d452bf7f6126 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:36:01.021715 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0fd6f549-43c3-4999-89d6-d452bf7f6126 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:36:01.187066 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.187609 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cc10d27b-3874-4cbe-8b05-b1194e371752 {{(pid=94433) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:36:01.192548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.193803 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e64e1401-ed61-4262-9e51-7e2e0638db94 admin admin] 10.222.0.16 "DELETE /v2.0/routers/cc10d27b-3874-4cbe-8b05-b1194e371752 HTTP/1.1" status: 204 len: 168 time: 1.5667922 Sep 03 11:36:01.197143 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38654) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:01.248822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Deleting subnet d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:36:01.252185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.287615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.304633 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['ea0c67e2-065e-475f-b1ce-c182f3c8ea81'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:36:01.367153 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.501378 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.531501 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:01.534804 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.538903 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1f26c673-eb08-470c-8f0d-c8a1a77181e5 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/d08fca75-5bf1-4f46-a3a4-8feca1cdbe2a HTTP/1.1" status: 204 len: 168 time: 0.3385296 Sep 03 11:36:01.539055 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c686992e-6a13-40a4-a8bb-5ed72afdc4d6 None None] Network 246bd34f-94aa-4eae-85ba-a0f3e2f663ce requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:36:01.540913 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38660) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:01.552857 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d480ca-d31e-40a3-8e37-97752c1121d9 req-28c333ab-ddbd-4404-aec0-b644df30cc76 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:01.554418 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99d480ca-d31e-40a3-8e37-97752c1121d9 req-28c333ab-ddbd-4404-aec0-b644df30cc76 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.0817204 Sep 03 11:36:01.596283 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99d480ca-d31e-40a3-8e37-97752c1121d9 req-3ecbfd82-e5f7-4d1d-9935-e0764a1b6925 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344739 Sep 03 11:36:01.637780 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.705627 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Deleting port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:36:01.705627 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.737431 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] DHCP port deletion for 246bd34f-94aa-4eae-85ba-a0f3e2f663ce request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:36:01.772165 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] For port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:01.772532 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.784533 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Calling delete_port for 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 owned by network:dhcp {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:36:01.787980 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Deleting port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:36:01.787980 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.854551 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] For port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,segment=NetworkSegment(177d43b1-95c4-4139-b1c2-29cb385a65be),segment_id=177d43b1-95c4-4139-b1c2-29cb385a65be)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:01.854949 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.866619 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Calling delete_port for 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:36:01.927761 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.942267 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:01.948787 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:36:01.959600 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Pushing event deleted for resources: {'Port': ['ID=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:01.962111 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] No DVR routers for this DVR port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 on host dv-cinder-760199-12-iscsi {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:36:01.976294 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] Pushing event deleted for resources: {'Port': ['ID=7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:01.980326 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f9c2c5e-79c0-463f-8008-f9821314808c None None] No DVR routers for this DVR port 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:36:02.038763 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.049489 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['246bd34f-94aa-4eae-85ba-a0f3e2f663ce']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:36:02.060812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '177d43b1-95c4-4139-b1c2-29cb385a65be') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:36:02.061149 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '177d43b1-95c4-4139-b1c2-29cb385a65be') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:36:02.071258 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.085041 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.091686 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Releasing vlan 391 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:36:02.093472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:36:02.093839 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:36:02.207474 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.214750 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.216746 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] 10.222.0.16 "DELETE /v2.0/networks/246bd34f-94aa-4eae-85ba-a0f3e2f663ce HTTP/1.1" status: 204 len: 168 time: 0.6747463 Sep 03 11:36:02.227324 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131f9d80-5cfa-4242-a4e4-cb7be8efe08f admin admin] Pushing event deleted for resources: {'Network': ['ID=246bd34f-94aa-4eae-85ba-a0f3e2f663ce,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:02.609895 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38698) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:02.697358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38702) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:02.697945 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8a1d3cdb-e24f-4d66-9996-710c0ae1a8c5 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8e0bcf21f2dd49fe9f29d6892da5d5cc&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0863016 Sep 03 11:36:02.782056 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.809993 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.863027 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809e4569-fa9d-4b3a-8b70-a1a1350f3ba7 req-7a1f3be3-56e5-477a-9225-94ec2ba7f904 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:02.871058 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-809e4569-fa9d-4b3a-8b70-a1a1350f3ba7 req-7a1f3be3-56e5-477a-9225-94ec2ba7f904 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.1476886 Sep 03 11:36:02.921462 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-809e4569-fa9d-4b3a-8b70-a1a1350f3ba7 req-b937279a-16ce-43c6-90d1-02c307259cd7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460997 Sep 03 11:36:02.933697 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.936609 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:02.937763 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f1838712-6d05-446c-b11b-0c22b2ff679e HTTP/1.1" status: 204 len: 168 time: 0.2395000 Sep 03 11:36:02.961406 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-856f2a3c-4f86-4c2a-b671-819cdeddd8a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1838712-6d05-446c-b11b-0c22b2ff679e,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:02.964923 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5560cb35-25cc-4f08-87c3-68abb05c40aa no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:36:03.032874 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 5560cb35-25cc-4f08-87c3-68abb05c40aa {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:36:03.033212 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5560cb35-25cc-4f08-87c3-68abb05c40aa not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:36:03.033625 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:36:03.063121 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:36:03.063466 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 7c2efc53-5a22-4d50-a5f3-5adb8d4a18e6 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:36:04.071584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03eeb7b8-8cc8-49d6-8129-7ed4bdc3db8e req-c0edeebf-5ebe-4c36-b170-bb022e4b270e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:04.082495 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-03eeb7b8-8cc8-49d6-8129-7ed4bdc3db8e req-c0edeebf-5ebe-4c36-b170-bb022e4b270e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.0711343 Sep 03 11:36:04.102523 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:36:04.140081 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-03eeb7b8-8cc8-49d6-8129-7ed4bdc3db8e req-34bc3e76-8351-4bdd-90c2-a2e36487b8b1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470545 Sep 03 11:36:04.187909 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:36:04.188558 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:04.296951 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:04.324058 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:04.326647 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-28ea3a90-3e2b-4153-b525-a6bebd1b5f1c" -d '{"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:04.351380 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:04.369222 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c076bfac-3ea5-4750-8435-e8532aca5b04 x-openstack-request-id: req-c076bfac-3ea5-4750-8435-e8532aca5b04 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:04.369516 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:04.369765 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c076bfac-3ea5-4750-8435-e8532aca5b04 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:04.370147 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'code': 200} Sep 03 11:36:04.416014 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:04.479012 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=7']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:05.257673 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3706b724-fe7f-44a9-a508-0d13338f07a0 req-6477efbc-a9fe-428a-90cf-648a7a5f2a7e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:05.259425 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3706b724-fe7f-44a9-a508-0d13338f07a0 req-6477efbc-a9fe-428a-90cf-648a7a5f2a7e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0562611 Sep 03 11:36:05.307324 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3706b724-fe7f-44a9-a508-0d13338f07a0 req-4ef4da51-5526-4523-8107-7895eaa10c38 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408602 Sep 03 11:36:05.972191 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38764) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:06.087715 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80918f8-5a03-4578-af5a-3c6a5bc35cb0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.188436 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80918f8-5a03-4578-af5a-3c6a5bc35cb0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.301532 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e80918f8-5a03-4578-af5a-3c6a5bc35cb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.355280 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e80918f8-5a03-4578-af5a-3c6a5bc35cb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c40728f-ac5a-4006-aa73-c5843c220728,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:06.362954 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38770) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:06.368744 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e80918f8-5a03-4578-af5a-3c6a5bc35cb0 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=8389788bde5b40b7939ee9a6ab8a9fe0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3954246 Sep 03 11:36:06.446626 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.473939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.517794 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf3bc60-f061-4a3e-94e3-4d000ac7bea0 req-c0a39ad0-b0f6-4228-b3fa-0c15056ba385 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:06.525344 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7bf3bc60-f061-4a3e-94e3-4d000ac7bea0 req-c0a39ad0-b0f6-4228-b3fa-0c15056ba385 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.1138806 Sep 03 11:36:06.569865 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7bf3bc60-f061-4a3e-94e3-4d000ac7bea0 req-b27c31fc-c490-41c8-8ee8-83bd5b01fc7a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433092 Sep 03 11:36:06.627303 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.629996 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:06.633905 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/4c40728f-ac5a-4006-aa73-c5843c220728 HTTP/1.1" status: 204 len: 168 time: 0.2679002 Sep 03 11:36:06.640925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58330dd8-bbda-416b-9322-8c4f2659abee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c40728f-ac5a-4006-aa73-c5843c220728,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:07.335696 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38782) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:07.359638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdac15e5-9943-4a91-b1ff-870a6418ddac admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.470360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdac15e5-9943-4a91-b1ff-870a6418ddac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.556175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdac15e5-9943-4a91-b1ff-870a6418ddac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.597395 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdac15e5-9943-4a91-b1ff-870a6418ddac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d2740d6-4c25-49cd-a44d-9f7e7526393f,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:07.607064 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bdac15e5-9943-4a91-b1ff-870a6418ddac admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=06f6b2c2d04943f3a92dc1b51ba5622c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2696850 Sep 03 11:36:07.608607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38786) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:07.684917 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.717153 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.742081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b33ab30f-fb5c-4600-9f94-0c5e1856817f req-5a44ed46-0ba6-419d-be05-56f484abd6ed tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:07.744114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b33ab30f-fb5c-4600-9f94-0c5e1856817f req-5a44ed46-0ba6-419d-be05-56f484abd6ed tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0578578 Sep 03 11:36:07.793850 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b33ab30f-fb5c-4600-9f94-0c5e1856817f req-7a391aea-2583-4374-b944-701b7ada2b51 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403755 Sep 03 11:36:07.858794 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.861795 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:07.865366 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/6d2740d6-4c25-49cd-a44d-9f7e7526393f HTTP/1.1" status: 204 len: 168 time: 0.2549160 Sep 03 11:36:07.875714 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1c981e-e7af-4a40-97c6-ba3172c19fac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d2740d6-4c25-49cd-a44d-9f7e7526393f,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:08.920413 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5552065c-7d61-4047-9917-bb36f9041c38 req-9e47dd93-7a23-4674-ad70-02671454dbba tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:08.921949 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5552065c-7d61-4047-9917-bb36f9041c38 req-9e47dd93-7a23-4674-ad70-02671454dbba tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0528307 Sep 03 11:36:08.960853 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5552065c-7d61-4047-9917-bb36f9041c38 req-a882ab9e-21d0-4444-b95c-7099c693b44b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327494 Sep 03 11:36:10.101638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba499f07-8c74-4adb-a304-3467e3f9bbe3 req-e8a4fc65-e02a-4a8f-ab70-dba4c4056fd4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:10.104886 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba499f07-8c74-4adb-a304-3467e3f9bbe3 req-e8a4fc65-e02a-4a8f-ab70-dba4c4056fd4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0595779 Sep 03 11:36:10.155480 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba499f07-8c74-4adb-a304-3467e3f9bbe3 req-51a17b7e-de6d-4166-ba2c-68a54d6e10bd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446324 Sep 03 11:36:11.247078 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38874) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:11.303264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d975a0-8d41-4d6b-baac-a1fe588ed654 req-5632457b-6e22-4b89-b86e-31e2f4f94760 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:11.304703 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8d975a0-8d41-4d6b-baac-a1fe588ed654 req-5632457b-6e22-4b89-b86e-31e2f4f94760 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0562646 Sep 03 11:36:11.373974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8d975a0-8d41-4d6b-baac-a1fe588ed654 req-76e281af-8f09-4792-b7ce-624e8c409293 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618434 Sep 03 11:36:11.404865 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:11.522208 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:11.584427 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:11.599753 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-09472599-ae9e-4df0-b70d-d5fd94d652d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:11.599753 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-09472599-ae9e-4df0-b70d-d5fd94d652d3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1099 time: 0.0732200 Sep 03 11:36:11.631781 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fc42151fae884df99e94f66212df9caa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3835831 Sep 03 11:36:11.632683 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42d39668-0638-45ad-afb9-f35a54d13a9e,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:11.634745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38878) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:11.647281 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.647681 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.651193 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee5cc00f-3290-44cc-932b-07bcd7abb72e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:11.772111 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:11.805904 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-8be6cad0-da2e-40ff-b4d9-207efec434ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:11.808121 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-8be6cad0-da2e-40ff-b4d9-207efec434ea service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.1585023 Sep 03 11:36:11.812794 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:11.916942 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-90eae0eb-83f6-4170-bdd1-6b1aea4df867 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1002 time: 0.0965264 Sep 03 11:36:11.977110 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-e05e9f4f-7e8c-447b-8a4f-17f87475a98f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:11.979266 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-e05e9f4f-7e8c-447b-8a4f-17f87475a98f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0553381 Sep 03 11:36:12.036359 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-bc960a26-9f26-4ac3-91a5-7f2f9f2879e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:12.037926 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-bc960a26-9f26-4ac3-91a5-7f2f9f2879e6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0492344 Sep 03 11:36:12.129857 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-680bfcfe-de9d-4273-bec1-a487692d057c service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828373 Sep 03 11:36:12.174809 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:12.174809 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:12.175347 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/42d39668-0638-45ad-afb9-f35a54d13a9e HTTP/1.1" status: 204 len: 168 time: 0.5393314 Sep 03 11:36:12.215491 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef3ca19f-09f7-4da5-8b84-e927fcb6e809 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42d39668-0638-45ad-afb9-f35a54d13a9e,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:12.247256 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-66efd2fe-8155-4a30-b1e4-21173cdab9fc req-7012c2b7-e7e9-410d-a691-930b6b871ff6 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1069942 Sep 03 11:36:12.522695 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e60df62-e53b-4cc6-900d-b3e86310345d req-a49f6214-0210-471b-a3b5-b15b9b00ed26 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:12.524358 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e60df62-e53b-4cc6-900d-b3e86310345d req-a49f6214-0210-471b-a3b5-b15b9b00ed26 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0778201 Sep 03 11:36:12.581918 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e60df62-e53b-4cc6-900d-b3e86310345d req-518197fe-4a31-4ff9-8ce7-3e1dd21ebbfc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484109 Sep 03 11:36:12.863848 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 38892) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:12.878001 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8491cd98-b480-43dc-9808-799fc5ceef61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:12.973638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8491cd98-b480-43dc-9808-799fc5ceef61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.129438 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-8491cd98-b480-43dc-9808-799fc5ceef61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.167680 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-8491cd98-b480-43dc-9808-799fc5ceef61 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=790b3efa1f8f49b5b6b4fc4db6c471d9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3024740 Sep 03 11:36:13.170532 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38900) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:13.172585 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8491cd98-b480-43dc-9808-799fc5ceef61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb3a1981-4ad1-457f-a6c7-f996585d3a92,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:13.231578 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.492881 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23e1684-3715-424a-b93a-e435bc9de665 req-41809730-4376-47f0-9724-53aad40e6269 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:13.494578 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a23e1684-3715-424a-b93a-e435bc9de665 req-41809730-4376-47f0-9724-53aad40e6269 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0577211 Sep 03 11:36:13.501611 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.532445 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a23e1684-3715-424a-b93a-e435bc9de665 req-a2d0e612-2381-4598-9ef9-b15a971b26c3 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316968 Sep 03 11:36:13.615499 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.618098 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.620088 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fb3a1981-4ad1-457f-a6c7-f996585d3a92 HTTP/1.1" status: 204 len: 168 time: 0.4474566 Sep 03 11:36:13.628306 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32aeac03-61e5-476d-8871-3471ac591a2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb3a1981-4ad1-457f-a6c7-f996585d3a92,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:13.715136 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d33bc81-fad3-47b8-bedc-31af3612ce54 req-5f66aa20-82ee-47a9-96d1-405797a3c701 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:13.716639 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3d33bc81-fad3-47b8-bedc-31af3612ce54 req-5f66aa20-82ee-47a9-96d1-405797a3c701 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0539336 Sep 03 11:36:13.746962 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:13.754855 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3d33bc81-fad3-47b8-bedc-31af3612ce54 req-3fe77431-c223-4269-b88d-78c195f9119e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318947 Sep 03 11:36:14.127183 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-6b59ca61-39df-4d94-b729-87b1b7e2bfe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.128957 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-6b59ca61-39df-4d94-b729-87b1b7e2bfe5 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1099 time: 0.0436187 Sep 03 11:36:14.228797 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-cd94d88f-a8b9-4b43-a35d-aec2bcb0108f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.230258 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-cd94d88f-a8b9-4b43-a35d-aec2bcb0108f service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0914021 Sep 03 11:36:14.299508 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-7c2f1772-0e25-4c1a-9dff-33c3abe040b1 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1002 time: 0.0590513 Sep 03 11:36:14.354246 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-f549b925-c97d-420d-8dd8-4e7ee9410969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.355831 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-f549b925-c97d-420d-8dd8-4e7ee9410969 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0479527 Sep 03 11:36:14.406635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-34046e76-995d-47d5-8652-4b53e12d6cd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.408084 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-34046e76-995d-47d5-8652-4b53e12d6cd4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0428481 Sep 03 11:36:14.504912 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-a1299a20-8d56-47fd-bc47-617984c8fb10 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876451 Sep 03 11:36:14.600653 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-583f2551-71ad-49dd-9992-c3764fb318d3 req-d7fe9606-d472-403f-8d42-1eea597bf700 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851712 Sep 03 11:36:14.651508 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33dfd8e8-8438-46d1-8415-65f11ecebfa6 req-77c10128-2d19-4873-a48f-88f4e3814277 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.653396 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33dfd8e8-8438-46d1-8415-65f11ecebfa6 req-77c10128-2d19-4873-a48f-88f4e3814277 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0516353 Sep 03 11:36:14.695491 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33dfd8e8-8438-46d1-8415-65f11ecebfa6 req-7082dbb6-dce2-4bb1-a149-316586ff9fec tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342636 Sep 03 11:36:14.880593 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0407486-3ee6-4153-9703-e37ff31212df req-daa98887-47d8-44ce-868d-052449b0fb0e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:14.881979 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a0407486-3ee6-4153-9703-e37ff31212df req-daa98887-47d8-44ce-868d-052449b0fb0e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0495014 Sep 03 11:36:14.920542 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a0407486-3ee6-4153-9703-e37ff31212df req-d656285c-b055-459c-9921-79d62ada045f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317969 Sep 03 11:36:15.364680 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-8a265fd4-1177-4469-91a0-805c2153b058 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:15.366202 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-8a265fd4-1177-4469-91a0-805c2153b058 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 945 time: 0.0527854 Sep 03 11:36:15.460199 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Deleting port 651dca67-4d21-4032-8b75-d461b8392ee2 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:36:15.460528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:15.551280 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] For port 651dca67-4d21-4032-8b75-d461b8392ee2, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=651dca67-4d21-4032-8b75-d461b8392ee2,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:15.554669 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:15.565794 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Calling delete_port for 651dca67-4d21-4032-8b75-d461b8392ee2 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:36:15.769966 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:15.789650 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['651dca67-4d21-4032-8b75-d461b8392ee2'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:36:15.818232 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7b8833a9-2663-4ffe-912b-9ff641c25a9a req-b42390ce-a368-442d-a3ef-076c272c75db tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 210 time: 0.0579064 Sep 03 11:36:15.821093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Pushing event deleted for resources: {'Port': ['ID=651dca67-4d21-4032-8b75-d461b8392ee2,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:15.881327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] No DVR routers for this DVR port 651dca67-4d21-4032-8b75-d461b8392ee2 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:36:15.883881 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:15.886039 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ee23e974-9b69-4423-aa89-70fc4f6d5a63 req-9ab32fea-f2e2-4fcc-afb1-4a9d5c50c315 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "DELETE /v2.0/ports/651dca67-4d21-4032-8b75-d461b8392ee2 HTTP/1.1" status: 204 len: 173 time: 0.5119593 Sep 03 11:36:15.886528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'name': 'network-vif-deleted', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:15.888793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acdbd670-e2d1-4e9a-8782-fce6836b3127" -d '{"events": [{"server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "name": "network-vif-deleted", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:16.052121 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3365e605-4a0e-46d8-9917-08b77961c607 req-da1ae285-bd9f-468b-b721-f29af91890c0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:16.053621 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3365e605-4a0e-46d8-9917-08b77961c607 req-da1ae285-bd9f-468b-b721-f29af91890c0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0563333 Sep 03 11:36:16.055269 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39b59ea7-b759-4107-a597-cb4c602f7ced x-openstack-request-id: req-39b59ea7-b759-4107-a597-cb4c602f7ced {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:16.055548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3075f124-4e98-4e4b-b775-90ed7199d139", "name": "network-vif-deleted", "tag": "651dca67-4d21-4032-8b75-d461b8392ee2", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:16.055867 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-39b59ea7-b759-4107-a597-cb4c602f7ced {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:16.056331 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3075f124-4e98-4e4b-b775-90ed7199d139', 'name': 'network-vif-deleted', 'tag': '651dca67-4d21-4032-8b75-d461b8392ee2', 'status': 'completed', 'code': 200} Sep 03 11:36:16.104263 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3365e605-4a0e-46d8-9917-08b77961c607 req-55d08821-cfb0-42b9-a9fc-ca8fdd681dba tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444059 Sep 03 11:36:16.924354 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2b7467ed-8d00-4fdd-9b7d-66bb929d57ec req-206753e5-9c8e-4bef-b126-e1df172d6c13 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=3075f124-4e98-4e4b-b775-90ed7199d139 HTTP/1.1" status: 200 len: 210 time: 0.0278230 Sep 03 11:36:17.194827 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 38998) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:17.227894 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29df32b9-622a-4767-9b83-245060343fe5 req-f1293ef2-542e-4d9d-942a-046bea5b0830 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:17.229456 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-29df32b9-622a-4767-9b83-245060343fe5 req-f1293ef2-542e-4d9d-942a-046bea5b0830 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 946 time: 0.0501986 Sep 03 11:36:17.268740 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-29df32b9-622a-4767-9b83-245060343fe5 req-fe420e79-fd5d-471c-b990-94b3868daf12 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334156 Sep 03 11:36:17.302244 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-37b94c08-9556-47fe-a0ff-82ba3c27cafe admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.391135 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-37b94c08-9556-47fe-a0ff-82ba3c27cafe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.393027 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:36:17.458317 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-37b94c08-9556-47fe-a0ff-82ba3c27cafe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.468372 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.497936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:17.497936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe826cc3-0106-4a2d-8f9c-ec988f82392a" -d '{"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-unplugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:17.498960 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-37b94c08-9556-47fe-a0ff-82ba3c27cafe admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=96b859ca6b854960ad0fccb34e07ddd9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3029101 Sep 03 11:36:17.501036 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39012) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:17.501325 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37b94c08-9556-47fe-a0ff-82ba3c27cafe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62053259-c816-4606-8ce5-0ecab7e02ee1,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:17.510922 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:17.534835 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6beadf6a-55cf-49ac-8253-29cb5deb9217 x-openstack-request-id: req-6beadf6a-55cf-49ac-8253-29cb5deb9217 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:17.535688 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-unplugged", "status": "failed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "code": 422}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:17.535688 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6beadf6a-55cf-49ac-8253-29cb5deb9217 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:17.535869 dv-cinder-760199-12-iscsi neutron-server[94434]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'code': 422} returned with failed status Sep 03 11:36:17.561926 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.569368 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.585929 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.616305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=8']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:17.717917 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.720483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:17.721633 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/62053259-c816-4606-8ce5-0ecab7e02ee1 HTTP/1.1" status: 204 len: 168 time: 0.2194154 Sep 03 11:36:17.730195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21aa990f-6fb7-4012-bc91-8b49929a012a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62053259-c816-4606-8ce5-0ecab7e02ee1,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:18.344892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39028) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:18.354718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-aacf325b-893c-4e0f-b7c6-93583d373581 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.448257 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-aacf325b-893c-4e0f-b7c6-93583d373581 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.541030 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-aacf325b-893c-4e0f-b7c6-93583d373581 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.585483 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-aacf325b-893c-4e0f-b7c6-93583d373581 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=3ad8ad9b19d84cab9edf44ef0e1347a7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2434537 Sep 03 11:36:18.586422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aacf325b-893c-4e0f-b7c6-93583d373581 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6df669e-fcea-4e93-bac3-738cccf58086,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:18.589235 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39038) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:18.639112 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.660175 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.715327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-aacd5b47-2810-4b43-8b88-2885f291ddb0 req-55b8a980-1e15-4f48-938a-cbd7c6f87d4b service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:36:18.719134 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-aacd5b47-2810-4b43-8b88-2885f291ddb0 req-55b8a980-1e15-4f48-938a-cbd7c6f87d4b service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1528707 Sep 03 11:36:18.763967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.766562 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:18.767746 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/c6df669e-fcea-4e93-bac3-738cccf58086 HTTP/1.1" status: 204 len: 168 time: 0.1777587 Sep 03 11:36:18.775465 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55ae347-447e-4629-bf71-1e55388d38bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6df669e-fcea-4e93-bac3-738cccf58086,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:19.060422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88da3970-d5ad-45be-bb84-736facd02321 req-5071dea3-12f7-4719-aefb-5f2932ebb46c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:19.061984 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-88da3970-d5ad-45be-bb84-736facd02321 req-5071dea3-12f7-4719-aefb-5f2932ebb46c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0502534 Sep 03 11:36:19.100948 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-88da3970-d5ad-45be-bb84-736facd02321 req-39a9d7bd-e69d-4326-8c73-eb02e7746d6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325112 Sep 03 11:36:19.560192 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39076) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:19.567050 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 651dca67-4d21-4032-8b75-d461b8392ee2 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:36:19.590366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 651dca67-4d21-4032-8b75-d461b8392ee2 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:36:19.590730 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 651dca67-4d21-4032-8b75-d461b8392ee2 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:36:19.647194 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-2ed882ed-db7c-4ec5-a2bf-b5ef97f2e285 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0858302 Sep 03 11:36:19.656354 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-45c9f8e4-ca8f-4aa0-a18f-6d392ceda707 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:36:19.657313 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-45c9f8e4-ca8f-4aa0-a18f-6d392ceda707 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052762 Sep 03 11:36:20.225607 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab03f3a6-b113-41c6-917b-70a8beafab44 req-7eac32a0-9fa0-4440-b225-7b62abcd7f1c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:20.227143 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ab03f3a6-b113-41c6-917b-70a8beafab44 req-7eac32a0-9fa0-4440-b225-7b62abcd7f1c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0517132 Sep 03 11:36:20.264702 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ab03f3a6-b113-41c6-917b-70a8beafab44 req-ab43dc95-be98-4512-b708-fe2d2b12f353 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310707 Sep 03 11:36:20.421500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39104) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:20.522955 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf0f412a-10da-463d-95e4-fab49730cd19 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.608614 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf0f412a-10da-463d-95e4-fab49730cd19 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.675641 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-bf0f412a-10da-463d-95e4-fab49730cd19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.714073 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-bf0f412a-10da-463d-95e4-fab49730cd19 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=bd491261e0204bc4b37218d237cd6924&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2907839 Sep 03 11:36:20.715381 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0f412a-10da-463d-95e4-fab49730cd19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56b0a130-c535-4929-8763-a0d0fa244f61,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:20.718061 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39108) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:36:20.773564 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.794008 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.929653 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.933263 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:20.934449 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/56b0a130-c535-4929-8763-a0d0fa244f61 HTTP/1.1" status: 204 len: 168 time: 0.2153621 Sep 03 11:36:20.943694 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68bf6418-308e-4173-8932-b08180f948dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56b0a130-c535-4929-8763-a0d0fa244f61,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:21.393724 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671d35c8-6f0a-4fd8-b004-f08f266da700 req-d3a9484c-7b83-41ef-8767-4d02fb632b66 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:21.395235 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-671d35c8-6f0a-4fd8-b004-f08f266da700 req-d3a9484c-7b83-41ef-8767-4d02fb632b66 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0570016 Sep 03 11:36:21.434229 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-671d35c8-6f0a-4fd8-b004-f08f266da700 req-7f264e8a-5b40-4ec4-a463-0aac6cf4465a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329461 Sep 03 11:36:22.588761 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1858b8de-8ec0-491e-9c80-cb53d7ce8785 req-6cb2259f-e7c3-4503-9abd-222d312d2379 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:22.593351 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1858b8de-8ec0-491e-9c80-cb53d7ce8785 req-6cb2259f-e7c3-4503-9abd-222d312d2379 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0652201 Sep 03 11:36:22.641136 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1858b8de-8ec0-491e-9c80-cb53d7ce8785 req-bc299c88-b14e-44fa-b8be-84c4819b37b5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410814 Sep 03 11:36:23.564009 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-33717a0e-2a3c-4668-b35f-6f2068d7a123 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.565509 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-33717a0e-2a3c-4668-b35f-6f2068d7a123 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 1097 time: 0.0790231 Sep 03 11:36:23.637497 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-91b09c85-e41e-4b72-8840-86414a4e4723 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.638930 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-91b09c85-e41e-4b72-8840-86414a4e4723 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1097 time: 0.0460579 Sep 03 11:36:23.658639 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-92c38172-d72a-442a-a8fa-31b908c4b7cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:23.740144 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-b92cc071-89c1-4208-81d1-699c9f9b84e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.741554 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-b92cc071-89c1-4208-81d1-699c9f9b84e0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0952172 Sep 03 11:36:23.828628 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d1ad9d-7729-4069-9132-c178989d7287 req-e33d397f-d9c1-41b8-86a6-bebf4ae0da45 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.830104 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3d1ad9d-7729-4069-9132-c178989d7287 req-e33d397f-d9c1-41b8-86a6-bebf4ae0da45 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.1072640 Sep 03 11:36:23.832286 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-7cb45180-9eea-4232-9856-69840801fdbf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1000 time: 0.0776732 Sep 03 11:36:23.901147 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b3d1ad9d-7729-4069-9132-c178989d7287 req-51723a65-1d8e-427d-88de-133623e6107f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633605 Sep 03 11:36:23.910208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-7451d91d-b6e6-4a36-939d-a37326df35f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.910208 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-7451d91d-b6e6-4a36-939d-a37326df35f0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0575037 Sep 03 11:36:23.962880 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-eb0e28e0-0168-4bb4-ad92-bc4e8ddd0d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:23.964810 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-eb0e28e0-0168-4bb4-ad92-bc4e8ddd0d2a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0466387 Sep 03 11:36:24.058935 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-8c943560-044e-4ed2-98d8-8fc57f8489fa service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842588 Sep 03 11:36:24.160738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d079eecb-bac5-4d30-8293-1916505dc8d0 req-337bc383-421a-47f6-b1c4-7bf6ec623b32 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934782 Sep 03 11:36:25.052221 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d79a1d0-0e4c-4ee6-b9ff-72b03ccb9434 req-1370061a-3d73-4897-828b-95a13b490222 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:25.063315 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d79a1d0-0e4c-4ee6-b9ff-72b03ccb9434 req-1370061a-3d73-4897-828b-95a13b490222 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0688505 Sep 03 11:36:25.108149 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d79a1d0-0e4c-4ee6-b9ff-72b03ccb9434 req-eddb0eaf-0aa3-42b8-86da-22ddfdcbfa3a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435402 Sep 03 11:36:26.255565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99fb8e7-bc26-470d-80e7-a3f37b6679bf req-5831096b-d02a-4dd2-9faa-dad18198544a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:26.257214 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d99fb8e7-bc26-470d-80e7-a3f37b6679bf req-5831096b-d02a-4dd2-9faa-dad18198544a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0574970 Sep 03 11:36:26.296955 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d99fb8e7-bc26-470d-80e7-a3f37b6679bf req-757896ee-ddcb-48bc-be5c-510574ce883c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327609 Sep 03 11:36:26.342844 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4a4295ba-8d27-479a-a3bb-c6f0b323eec4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:26.721588 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:27.428238 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014eaefd-a888-4730-acbc-3c674407892e req-05202013-22a2-4e54-9cf3-e9265dc5b88d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:27.429788 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-014eaefd-a888-4730-acbc-3c674407892e req-05202013-22a2-4e54-9cf3-e9265dc5b88d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0575550 Sep 03 11:36:27.467481 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-014eaefd-a888-4730-acbc-3c674407892e req-e2fd340e-ddf2-4d6e-8bb6-84ae1445eb88 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317945 Sep 03 11:36:27.643657 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:28.606008 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86d67ff-0a1b-4d48-88da-1cfbc7f7437d req-ebcc4006-9a12-429c-a945-49a9ec1499d7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:28.607547 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d86d67ff-0a1b-4d48-88da-1cfbc7f7437d req-ebcc4006-9a12-429c-a945-49a9ec1499d7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0490742 Sep 03 11:36:28.647434 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d86d67ff-0a1b-4d48-88da-1cfbc7f7437d req-4beb5a0f-d722-4580-bb56-2953ff4127c7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328870 Sep 03 11:36:29.053156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:29.781130 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b17be0c-92d1-4533-a54b-7b5897e31011 req-69cdae4f-1df2-4ddb-90b3-1c10869efa6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:29.782656 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8b17be0c-92d1-4533-a54b-7b5897e31011 req-69cdae4f-1df2-4ddb-90b3-1c10869efa6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0488584 Sep 03 11:36:29.834278 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8b17be0c-92d1-4533-a54b-7b5897e31011 req-8e8326d7-bc0c-4685-a225-fd994dc4acde tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455542 Sep 03 11:36:30.986074 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83771f0-f3de-401a-8995-88da258d7dde req-01523e44-1412-42d1-bad9-3a2c4d007df8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:30.987550 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b83771f0-f3de-401a-8995-88da258d7dde req-01523e44-1412-42d1-bad9-3a2c4d007df8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0627961 Sep 03 11:36:31.026020 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b83771f0-f3de-401a-8995-88da258d7dde req-b6ee3e00-4617-40cb-ac4e-e3cea5bfa3be tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325489 Sep 03 11:36:32.168375 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b88f79-61fe-4757-bf67-69b48736426c req-5ec0bc37-5464-45f2-ab05-aa05a11f36b4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:32.169912 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-31b88f79-61fe-4757-bf67-69b48736426c req-5ec0bc37-5464-45f2-ab05-aa05a11f36b4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0591121 Sep 03 11:36:32.221508 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-31b88f79-61fe-4757-bf67-69b48736426c req-0211b243-80c1-43c5-b9cd-3607aa9196da tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454073 Sep 03 11:36:33.375344 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4f74c-4f94-4abc-9e99-4a2b3c2a16fc req-dd407ddb-b096-41f5-ba81-b14a88187851 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:33.376810 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8f4f74c-4f94-4abc-9e99-4a2b3c2a16fc req-dd407ddb-b096-41f5-ba81-b14a88187851 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0646713 Sep 03 11:36:33.413866 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8f4f74c-4f94-4abc-9e99-4a2b3c2a16fc req-dafc4430-2bf4-4303-9a3b-af0b9d22d2c4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311751 Sep 03 11:36:34.554353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c4da56-6718-4ec0-a915-bae4b8035174 req-c5c7730a-1b60-4a4c-a75b-6103a8f42899 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:34.555832 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a3c4da56-6718-4ec0-a915-bae4b8035174 req-c5c7730a-1b60-4a4c-a75b-6103a8f42899 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0513139 Sep 03 11:36:34.600737 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a3c4da56-6718-4ec0-a915-bae4b8035174 req-e8647a50-422d-42c9-91ad-0a4f68c330e1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377891 Sep 03 11:36:35.447436 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-e7a66bad-aee9-4564-af11-3f786b769b70 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:35.448882 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-e7a66bad-aee9-4564-af11-3f786b769b70 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/networks?id=c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 200 len: 814 time: 0.1128874 Sep 03 11:36:35.464475 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-308acdd9-0517-4da3-8531-de94b524ce63 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/quotas/2dcf476cde84427596b9b0192490da69 HTTP/1.1" status: 200 len: 375 time: 0.0089796 Sep 03 11:36:35.503602 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-77ad1f6f-4cff-421f-a13b-cbc4f3c8f9f7 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0338409 Sep 03 11:36:35.597699 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-968ebddf-8f39-405c-8b16-b665fbf866b4 service neutron] 10.222.0.16 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854511 Sep 03 11:36:36.008293 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-46869b77-d148-47f6-b793-42da3b0b6437 service neutron] 10.222.0.16 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4020631 Sep 03 11:36:36.016565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d38fc75-c34f-4f83-8997-2c9fe2a82cff req-3485f1e5-beb0-4321-8402-90561805610c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:36.017994 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d38fc75-c34f-4f83-8997-2c9fe2a82cff req-3485f1e5-beb0-4321-8402-90561805610c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0667384 Sep 03 11:36:36.060897 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d38fc75-c34f-4f83-8997-2c9fe2a82cff req-e533f721-a260-4944-9fad-1ea8fff9576c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371633 Sep 03 11:36:36.279510 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b6d011be-16b9-419f-9db6-0f5db987ce92 req-047859da-64ae-4fa6-b1ed-cc16c6443c32 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 210 time: 0.0372522 Sep 03 11:36:37.185736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e922a43c-e215-48bd-92a4-90ccc82b2baf req-ca6c09b8-3647-46a9-b523-f0b7bc90bbce tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:37.190915 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e922a43c-e215-48bd-92a4-90ccc82b2baf req-ca6c09b8-3647-46a9-b523-f0b7bc90bbce tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0516143 Sep 03 11:36:37.225953 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e922a43c-e215-48bd-92a4-90ccc82b2baf req-1894e6b6-c7fd-4d5e-a90e-328bc0e3c0d2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318055 Sep 03 11:36:37.373610 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-09a3b9eb-9e0d-4b04-96b1-d1e0228d7bbc req-d5516229-eeae-4841-b5fa-2d27e4cb3acc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 210 time: 0.0263679 Sep 03 11:36:38.160707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-7ed7abea-af67-4669-8886-56bc4eede175 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:38.162079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-7ed7abea-af67-4669-8886-56bc4eede175 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "GET /v2.0/networks?id=c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 200 len: 814 time: 0.1024232 Sep 03 11:36:38.176364 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Request body: {'port': {'device_id': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1', 'admin_state_up': True, 'tenant_id': '2dcf476cde84427596b9b0192490da69'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:36:38.350692 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-619d35e1-44d7-40b6-b70e-140e1db8882d req-aaaa3a06-46f9-432e-b3d4-ac6efe881924 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:38.352201 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-619d35e1-44d7-40b6-b70e-140e1db8882d req-aaaa3a06-46f9-432e-b3d4-ac6efe881924 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0528147 Sep 03 11:36:38.353324 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Made reservation on behalf of 2dcf476cde84427596b9b0192490da69 for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:36:38.356593 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:38.453628 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-619d35e1-44d7-40b6-b70e-140e1db8882d req-b786f67b-63e3-46af-85c9-b866f56bb2dd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0940254 Sep 03 11:36:38.482804 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf7f0e35-821e-449c-a47e-2483f1b99e7f req-66aad111-d802-4714-a427-d1e5feaa0f45 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 210 time: 0.0369453 Sep 03 11:36:38.539545 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Allocated IP 172.20.0.2 (c725f14d-842c-445d-9fae-44b313e242c1/cb7916f5-99f8-402c-b4ad-af12c8ae4adb/17908d40-6292-4dfd-8db6-648a2fa52d25) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:36:38.683315 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:38.844602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:38.890523 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Network c725f14d-842c-445d-9fae-44b313e242c1 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:36:38.893316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:36:38.897118 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:36:38.922255 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Pushing event updated for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:38.947668 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:36:38.948985 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:38.949588 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.030918 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-c9c48156-edf8-431f-b08b-c9ae26248910 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8579800 Sep 03 11:36:39.042542 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Request body: {'port': {'device_id': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:36:39.093702 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.351986 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17908d40-6292-4dfd-8db6-648a2fa52d25 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:36:39.359175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.370557 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Transition to ACTIVE for port object 17908d40-6292-4dfd-8db6-648a2fa52d25 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:36:39.448986 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.500577 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Pushing event updated for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:39.628677 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Attempting to bind port 17908d40-6292-4dfd-8db6-648a2fa52d25 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:36:39.629007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Attempting to bind port 17908d40-6292-4dfd-8db6-648a2fa52d25 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:36:39.629333 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Attempting to bind port 17908d40-6292-4dfd-8db6-648a2fa52d25 on network c725f14d-842c-445d-9fae-44b313e242c1 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:36:39.641750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ba0c64-5e73-44f0-9336-d5b8daf22db0 req-4ab234f1-78ab-40bc-8f03-63f79b910299 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:39.643274 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-09ba0c64-5e73-44f0-9336-d5b8daf22db0 req-4ab234f1-78ab-40bc-8f03-63f79b910299 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.1066148 Sep 03 11:36:39.647675 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Port 17908d40-6292-4dfd-8db6-648a2fa52d25 on network c725f14d-842c-445d-9fae-44b313e242c1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:36:39.647991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Attempting to bind port 17908d40-6292-4dfd-8db6-648a2fa52d25 on network c725f14d-842c-445d-9fae-44b313e242c1 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:36:39.661299 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155783f0-016e-4957-b543-beb9aa4487ac req-c98fe944-5dd0-44e2-b3be-e83fccd9702f tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:39.662719 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-155783f0-016e-4957-b543-beb9aa4487ac req-c98fe944-5dd0-44e2-b3be-e83fccd9702f tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 943 time: 0.0935550 Sep 03 11:36:39.668649 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 36, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:36:39.668980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Checking segment: {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:36:39.669348 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Bound using segment: {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:36:39.669784 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Bound port: 17908d40-6292-4dfd-8db6-648a2fa52d25, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8118ee45-fe26-4e61-b528-5af58071eb6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:36:39.670134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.745338 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-09ba0c64-5e73-44f0-9336-d5b8daf22db0 req-b72f1482-edbe-4e0d-8bb7-6235d2695446 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0935738 Sep 03 11:36:39.763245 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-155783f0-016e-4957-b543-beb9aa4487ac req-b1a118b8-b594-4382-8600-f5cbff8cd41e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842261 Sep 03 11:36:39.788307 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:36:39.791295 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=17908d40-6292-4dfd-8db6-648a2fa52d25,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:36:39.849892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.891063 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:39.895468 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:39.895468 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] 10.222.0.11 "PUT /v2.0/ports/17908d40-6292-4dfd-8db6-648a2fa52d25 HTTP/1.1" status: 200 len: 1093 time: 0.8545964 Sep 03 11:36:39.895468 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:39.895849 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a" -d '{"events": [{"name": "network-changed", "server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:39.917210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849f1034-f65f-4b20-9ebb-45d8bb0e5e64 service neutron] Pushing event updated for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:39.941674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0057e25-bbd9-44e7-b149-07a8e35477b8 x-openstack-request-id: req-f0057e25-bbd9-44e7-b149-07a8e35477b8 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:39.941674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:39.941674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-f0057e25-bbd9-44e7-b149-07a8e35477b8 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:39.941674 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25', 'status': 'completed', 'code': 200} Sep 03 11:36:39.995205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-580db141-439c-4e7d-97ec-af797ce14263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:39.996729 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-580db141-439c-4e7d-97ec-af797ce14263 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 1096 time: 0.0421705 Sep 03 11:36:40.093150 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-a7122379-8fbe-42c2-adf0-2ba492850bc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.094701 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-a7122379-8fbe-42c2-adf0-2ba492850bc9 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=2dcf476cde84427596b9b0192490da69&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0908093 Sep 03 11:36:40.190896 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-853177cf-21a2-4e9d-94c3-18fc7dfa386d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.192366 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca9fa71a-3f62-408d-9cb6-bc52938aab3a req-853177cf-21a2-4e9d-94c3-18fc7dfa386d service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0910800 Sep 03 11:36:40.267235 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-71a6f72d-1701-420c-af56-202bd7e3541d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.268628 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-71a6f72d-1701-420c-af56-202bd7e3541d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=2dcf476cde84427596b9b0192490da69&device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 1096 time: 0.0406017 Sep 03 11:36:40.314460 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-5be8e0bc-3de1-46a4-9609-e89e4918db5b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=17908d40-6292-4dfd-8db6-648a2fa52d25 HTTP/1.1" status: 200 len: 217 time: 0.0375609 Sep 03 11:36:40.363383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-195931c0-2351-49f5-8257-bf3535e78a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.364738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-195931c0-2351-49f5-8257-bf3535e78a7b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=cb7916f5-99f8-402c-b4ad-af12c8ae4adb HTTP/1.1" status: 200 len: 854 time: 0.0428026 Sep 03 11:36:40.396510 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-35717698-cfd0-45b3-b087-6928e166d228 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c725f14d-842c-445d-9fae-44b313e242c1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241563 Sep 03 11:36:40.489936 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-8447738d-0255-4d47-a6a5-0f6d38db5c8f service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857971 Sep 03 11:36:40.578505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-61b853dc-8a7a-40c3-ae91-ed5bcce779d8 req-7c81593e-abbb-4450-a9cb-be9987f41c5f service neutron] 10.222.0.11 "GET /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816002 Sep 03 11:36:40.904988 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69506f21-3ad1-4627-8766-c8564bb031ea req-ff037cd0-c603-49bd-b559-8763706b23b7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.907177 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-69506f21-3ad1-4627-8766-c8564bb031ea req-ff037cd0-c603-49bd-b559-8763706b23b7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0887437 Sep 03 11:36:40.929738 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e85af1-329d-4352-a84d-57d25268ddf8 req-16870ee5-e5b2-4e0b-aa4c-65d17743bdb5 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:40.931244 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2e85af1-329d-4352-a84d-57d25268ddf8 req-16870ee5-e5b2-4e0b-aa4c-65d17743bdb5 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 943 time: 0.0856698 Sep 03 11:36:40.987555 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-69506f21-3ad1-4627-8766-c8564bb031ea req-01c9ddc3-e308-4e5b-a692-dbaa4ae29f73 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0719142 Sep 03 11:36:40.994673 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2e85af1-329d-4352-a84d-57d25268ddf8 req-30bd421b-c52a-442f-9aaa-1f554abbe666 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544698 Sep 03 11:36:42.137258 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74a1e26-4610-4aa7-b3f5-103ea25b1f83 req-46944197-5783-448b-9b7e-408fdea869eb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:42.138747 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f74a1e26-4610-4aa7-b3f5-103ea25b1f83 req-46944197-5783-448b-9b7e-408fdea869eb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0761340 Sep 03 11:36:42.145976 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d086e4-85fe-4d7f-bec9-29281b2e101e req-3749605f-6578-477e-94a5-5cfe9c564367 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:42.147382 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-95d086e4-85fe-4d7f-bec9-29281b2e101e req-3749605f-6578-477e-94a5-5cfe9c564367 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 943 time: 0.0866272 Sep 03 11:36:42.206540 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f74a1e26-4610-4aa7-b3f5-103ea25b1f83 req-056ec0a5-309a-4875-b9ec-2cbe518aed8d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581992 Sep 03 11:36:42.209326 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-95d086e4-85fe-4d7f-bec9-29281b2e101e req-8373deb2-bd68-41c4-88fc-5efb89843250 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553539 Sep 03 11:36:43.352112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21780365-bb7f-40a9-a156-7a20158c0e1b req-c860e510-38b2-429f-ad8f-0d69c9aef959 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:43.353594 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-21780365-bb7f-40a9-a156-7a20158c0e1b req-c860e510-38b2-429f-ad8f-0d69c9aef959 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 943 time: 0.0775013 Sep 03 11:36:43.361539 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c6f5fd-5bca-4c17-ad06-d744cea61f27 req-bb0d96e4-8f0f-4e5c-b518-b406202ccbfa tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:43.362954 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a4c6f5fd-5bca-4c17-ad06-d744cea61f27 req-bb0d96e4-8f0f-4e5c-b518-b406202ccbfa tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0773430 Sep 03 11:36:43.415025 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-21780365-bb7f-40a9-a156-7a20158c0e1b req-e4353f16-51e6-4820-a63e-da0c8b189d53 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511124 Sep 03 11:36:43.427348 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a4c6f5fd-5bca-4c17-ad06-d744cea61f27 req-933d2bfe-e3e2-42a9-ab3d-2b3db37fc452 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0577638 Sep 03 11:36:43.531861 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 17908d40-6292-4dfd-8db6-648a2fa52d25 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:36:43.629352 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=17908d40-6292-4dfd-8db6-648a2fa52d25,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:43.640927 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '17908d40-6292-4dfd-8db6-648a2fa52d25', 'network_id': 'c725f14d-842c-445d-9fae-44b313e242c1', 'port_id': '17908d40-6292-4dfd-8db6-648a2fa52d25', 'mac_address': 'fa:16:3e:3a:a7:92', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb7916f5-99f8-402c-b4ad-af12c8ae4adb', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:36:43.676658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:43.690050 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17908d40-6292-4dfd-8db6-648a2fa52d25 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:36:43.709461 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=17908d40-6292-4dfd-8db6-648a2fa52d25,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:43.795107 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:43.841624 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:43.842247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:43.849183 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.849804 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.849919 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.850169 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.850593 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.850924 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.851247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.851571 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.851893 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.852211 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.852526 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:43.852842 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:36:44.014401 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['17908d40-6292-4dfd-8db6-648a2fa52d25'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:36:44.574508 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aaa1686-c7be-4c5a-909e-25e22d67f8b8 req-3eddee63-c271-4d57-98e6-23a2e4f154dc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:44.575982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2aaa1686-c7be-4c5a-909e-25e22d67f8b8 req-3eddee63-c271-4d57-98e6-23a2e4f154dc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 944 time: 0.0825219 Sep 03 11:36:44.587972 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1450b90c-c48b-4e91-b0b5-2e7f021172e4 req-61daf2e7-b0d2-46dd-ba4f-0e26cd0560d7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:44.589380 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1450b90c-c48b-4e91-b0b5-2e7f021172e4 req-61daf2e7-b0d2-46dd-ba4f-0e26cd0560d7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0665677 Sep 03 11:36:44.643646 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2aaa1686-c7be-4c5a-909e-25e22d67f8b8 req-f32bfa0c-0271-4494-a71c-2a26fea8b7bc tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533316 Sep 03 11:36:44.648527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1450b90c-c48b-4e91-b0b5-2e7f021172e4 req-cb860894-25ff-4241-9e53-13d6e3d7bcf2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517311 Sep 03 11:36:45.543345 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 17908d40-6292-4dfd-8db6-648a2fa52d25 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:36:45.660440 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 17908d40-6292-4dfd-8db6-648a2fa52d25 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:36:45.664140 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 17908d40-6292-4dfd-8db6-648a2fa52d25 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:36:45.664504 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:45.746055 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:45.769573 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:45.771890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08f2e602-8417-407f-91df-91c3a39f3cbd" -d '{"events": [{"server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "name": "network-vif-plugged", "status": "completed", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:45.784386 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=17908d40-6292-4dfd-8db6-648a2fa52d25,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:45.797263 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519cfc98-be03-448e-8f7f-4138d78727c9 req-6e374518-6836-4e7a-8d96-d178b22820a6 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:45.798745 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-519cfc98-be03-448e-8f7f-4138d78727c9 req-6e374518-6836-4e7a-8d96-d178b22820a6 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 944 time: 0.0828285 Sep 03 11:36:45.806744 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be86c00-df0c-4f8b-a3bf-b649f7f6651b req-43269455-8907-45b3-a442-9f0411caf0e1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:45.808109 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9be86c00-df0c-4f8b-a3bf-b649f7f6651b req-43269455-8907-45b3-a442-9f0411caf0e1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0809231 Sep 03 11:36:45.849328 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:45.864500 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-519cfc98-be03-448e-8f7f-4138d78727c9 req-1344c703-d573-40e2-878d-916c7d81390e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554125 Sep 03 11:36:45.871401 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9be86c00-df0c-4f8b-a3bf-b649f7f6651b req-cee7e01e-fe96-421a-878e-2bdcc72dc195 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533578 Sep 03 11:36:45.909747 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08dea6b1-9fbe-43b3-af00-64769b4188cc x-openstack-request-id: req-08dea6b1-9fbe-43b3-af00-64769b4188cc {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:45.911387 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "name": "network-vif-plugged", "status": "completed", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:45.911387 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-08dea6b1-9fbe-43b3-af00-64769b4188cc {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:45.911387 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25', 'code': 200} Sep 03 11:36:45.911665 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:46.241561 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a04503-81bf-4f73-acb0-45ae418b65c8 req-bde5ba4d-0c3e-4ad2-86df-378aa7ac9b53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:46.243063 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-91a04503-81bf-4f73-acb0-45ae418b65c8 req-bde5ba4d-0c3e-4ad2-86df-378aa7ac9b53 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 1098 time: 0.0402093 Sep 03 11:36:46.275930 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-91a04503-81bf-4f73-acb0-45ae418b65c8 req-8ad43a14-ebb4-4f3e-b033-bbfc4d20c8af service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0258617 Sep 03 11:36:47.012301 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-becdbdfa-c643-4f1d-98f5-25a0f875fe24 req-34be35ff-60f7-4367-81c9-2ece5175398b tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:47.013795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-becdbdfa-c643-4f1d-98f5-25a0f875fe24 req-34be35ff-60f7-4367-81c9-2ece5175398b tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 945 time: 0.0815167 Sep 03 11:36:47.025860 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c741fd3b-1423-4d24-a0b1-39c11084780b req-723a197f-7585-4eae-8e3c-877643fa9807 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:47.027292 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c741fd3b-1423-4d24-a0b1-39c11084780b req-723a197f-7585-4eae-8e3c-877643fa9807 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0687099 Sep 03 11:36:47.075406 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-becdbdfa-c643-4f1d-98f5-25a0f875fe24 req-046c6f2e-d526-456e-9b73-a70752a1588c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471861 Sep 03 11:36:47.087906 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c741fd3b-1423-4d24-a0b1-39c11084780b req-cd14e975-2316-4bfa-abd3-2c4888c5ba06 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540679 Sep 03 11:36:48.219766 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7ff8b4-8eb2-428c-87e5-78636beb6a16 req-143900dc-a32c-4f88-b35c-03360b89a249 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:48.221230 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c7ff8b4-8eb2-428c-87e5-78636beb6a16 req-143900dc-a32c-4f88-b35c-03360b89a249 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 945 time: 0.0809195 Sep 03 11:36:48.232854 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bdb75ca-da2f-4586-892f-12a267d8cdd6 req-ca359aa5-6ea1-47b4-9d8a-8a87a6ca818f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:48.234454 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8bdb75ca-da2f-4586-892f-12a267d8cdd6 req-ca359aa5-6ea1-47b4-9d8a-8a87a6ca818f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0681889 Sep 03 11:36:48.286288 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9c7ff8b4-8eb2-428c-87e5-78636beb6a16 req-32c4e73a-d03d-4745-b048-3b7602699b07 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509171 Sep 03 11:36:48.293381 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8bdb75ca-da2f-4586-892f-12a267d8cdd6 req-15ba4209-6b17-4d3b-96cf-8466748602d6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524399 Sep 03 11:36:49.412803 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40aa24b-1f3e-45b7-ae4b-4c4521e71780 req-838bad4f-8fc9-44e2-9bc9-8388602cc22a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:49.414282 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e40aa24b-1f3e-45b7-ae4b-4c4521e71780 req-838bad4f-8fc9-44e2-9bc9-8388602cc22a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0490782 Sep 03 11:36:49.450856 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e40aa24b-1f3e-45b7-ae4b-4c4521e71780 req-241deb45-ad91-467c-9ccf-9355d2d1f392 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308084 Sep 03 11:36:50.572909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db3c136-05b9-4914-a632-6725f249e405 req-46a4a064-f2ed-4257-a787-2c81db71f6f1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:50.574369 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1db3c136-05b9-4914-a632-6725f249e405 req-46a4a064-f2ed-4257-a787-2c81db71f6f1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0481577 Sep 03 11:36:50.611333 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1db3c136-05b9-4914-a632-6725f249e405 req-84dc32a2-043a-422e-99a9-113b57f039a5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310931 Sep 03 11:36:51.730202 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b540fac-fbdc-4fc4-ab3a-027bcfa3cc75 req-c03b8153-57b7-465b-810f-d701fe7280a4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:51.731663 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7b540fac-fbdc-4fc4-ab3a-027bcfa3cc75 req-c03b8153-57b7-465b-810f-d701fe7280a4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0507185 Sep 03 11:36:51.769056 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7b540fac-fbdc-4fc4-ab3a-027bcfa3cc75 req-a5aee74f-0541-4a18-94e1-34ce059864eb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308247 Sep 03 11:36:52.886865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817c935a-5c9d-48a9-9781-46531df27a47 req-e1fe4362-d573-4604-97ac-6d90425afa35 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:52.888320 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-817c935a-5c9d-48a9-9781-46531df27a47 req-e1fe4362-d573-4604-97ac-6d90425afa35 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0484393 Sep 03 11:36:52.926360 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-817c935a-5c9d-48a9-9781-46531df27a47 req-81927ac8-d6d9-4ecb-bb13-df58710f15c3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314434 Sep 03 11:36:53.669579 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0e5cba8c-b2d3-457b-96a6-cd1cfcb9fd9d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:54.044787 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2347be0b-4031-4a3a-badb-3c5610c7874a req-fed52cb4-f947-427c-850f-92e7dd94cb39 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:54.046267 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2347be0b-4031-4a3a-badb-3c5610c7874a req-fed52cb4-f947-427c-850f-92e7dd94cb39 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0483196 Sep 03 11:36:54.085212 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2347be0b-4031-4a3a-badb-3c5610c7874a req-0b95224c-b310-4f98-bf90-ab2d724a4085 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313056 Sep 03 11:36:55.206627 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b146f05f-1f05-407d-bb68-2fedabc59e4c req-c4625f34-4b58-424f-a103-5d4968c7eaf7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:55.208091 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b146f05f-1f05-407d-bb68-2fedabc59e4c req-c4625f34-4b58-424f-a103-5d4968c7eaf7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0518274 Sep 03 11:36:55.245167 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b146f05f-1f05-407d-bb68-2fedabc59e4c req-f1fa2227-1611-459f-be81-07408bfbacdd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312514 Sep 03 11:36:56.450743 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768fefd7-0645-4d3f-93ff-faee11a2757b req-181dbaea-0978-4108-846f-6d50948ea9df tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:56.450743 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-768fefd7-0645-4d3f-93ff-faee11a2757b req-181dbaea-0978-4108-846f-6d50948ea9df tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0489860 Sep 03 11:36:56.450743 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-768fefd7-0645-4d3f-93ff-faee11a2757b req-ae91a494-2e01-4424-b041-b660b5052cb2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315158 Sep 03 11:36:56.503950 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0beda04b-f3d6-451b-bc2b-d1db2c40d5bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:56.700556 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:57.533669 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec9fabe-0848-4754-bcfd-9396d7ae8536 req-aed01c77-662c-49f3-8ea6-4ecd34fde08c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:57.535202 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ec9fabe-0848-4754-bcfd-9396d7ae8536 req-aed01c77-662c-49f3-8ea6-4ecd34fde08c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 944 time: 0.0498197 Sep 03 11:36:57.572669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:36:57.573260 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ec9fabe-0848-4754-bcfd-9396d7ae8536 req-cf7ee605-a43d-4212-8293-910da562015e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321300 Sep 03 11:36:57.651917 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:57.678349 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:57.689584 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'mac_address': 'fa:16:3e:5b:26:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:36:57.725214 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:57.737800 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:36:57.756995 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:57.848897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:57.895498 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=9']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:36:58.075259 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['ea0c67e2-065e-475f-b1ce-c182f3c8ea81'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:36:58.695398 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc36f3db-14ea-45c5-af83-3741ef9d6c7a req-24a922ef-f4c9-4794-a545-3091280d3744 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:58.696853 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fc36f3db-14ea-45c5-af83-3741ef9d6c7a req-24a922ef-f4c9-4794-a545-3091280d3744 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.0512307 Sep 03 11:36:58.738962 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fc36f3db-14ea-45c5-af83-3741ef9d6c7a req-a841983c-c60b-46d7-95b2-35c8a5512a83 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362527 Sep 03 11:36:59.060316 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:59.605357 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:36:59.653299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:36:59.653663 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:59.737254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:59.758959 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:36:59.761177 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81692160-2a13-40b4-9507-e98d2a089bf2" -d '{"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:36:59.774879 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:36:59.800942 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:36:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99936bc7-51b7-4567-97c2-3a1088d33113 x-openstack-request-id: req-99936bc7-51b7-4567-97c2-3a1088d33113 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:36:59.804835 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-plugged", "status": "completed", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:36:59.804835 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-99936bc7-51b7-4567-97c2-3a1088d33113 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:36:59.804835 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'code': 200} Sep 03 11:36:59.858403 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:36:59.866098 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea28558-9981-4ca6-b756-d991d2bc5b14 req-5618703e-7cc8-4ee4-afb7-0f4050a4da5b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:36:59.867643 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ea28558-9981-4ca6-b756-d991d2bc5b14 req-5618703e-7cc8-4ee4-afb7-0f4050a4da5b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 945 time: 0.0514479 Sep 03 11:36:59.907548 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ea28558-9981-4ca6-b756-d991d2bc5b14 req-e12db224-4952-419f-89da-0709d20485b5 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332248 Sep 03 11:36:59.909451 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=10']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:00.420407 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dce470b-7c60-4e11-ac97-dcb4c69d0a47 req-5400e65b-13e9-4a6c-9b10-00d2f7d444d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:00.421972 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dce470b-7c60-4e11-ac97-dcb4c69d0a47 req-5400e65b-13e9-4a6c-9b10-00d2f7d444d1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1100 time: 0.0394936 Sep 03 11:37:00.455674 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5dce470b-7c60-4e11-ac97-dcb4c69d0a47 req-52805926-c35b-45b2-8d32-20b78aa8ee69 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0268724 Sep 03 11:37:01.038466 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f7a384-3173-41b4-88a6-9f709d51d40a req-294796c7-ad21-4723-9ae6-b2fca739804e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:01.039936 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-89f7a384-3173-41b4-88a6-9f709d51d40a req-294796c7-ad21-4723-9ae6-b2fca739804e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0521157 Sep 03 11:37:01.077737 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-89f7a384-3173-41b4-88a6-9f709d51d40a req-e55170f4-fc58-485a-b42a-b253e4fd614e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316074 Sep 03 11:37:02.202315 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d759ff9b-0adf-44dd-9466-b705f3929d96 req-4b836742-444f-4f10-a0af-fd7e6cb97c7b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:02.204358 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d759ff9b-0adf-44dd-9466-b705f3929d96 req-4b836742-444f-4f10-a0af-fd7e6cb97c7b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0531113 Sep 03 11:37:02.237445 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39556) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:02.248048 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d759ff9b-0adf-44dd-9466-b705f3929d96 req-52ff1956-8f0c-41f6-a1db-dcedbb717336 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377359 Sep 03 11:37:02.343453 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.437265 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.523296 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.565114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=368b7b53b3f14969b6e122983c1e8609&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3266304 Sep 03 11:37:02.566002 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=866ad972-c7ca-4341-867f-697a00fbbccc,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:02.567879 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39566) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:02.573249 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.573587 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.573931 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.574269 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.574620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.574953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.575278 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.575602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.575924 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.576245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.576561 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.576877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5368ced-2097-458b-9ab0-acee4c361bea admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:02.617824 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.642858 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.757705 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.760395 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:02.761524 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/866ad972-c7ca-4341-867f-697a00fbbccc HTTP/1.1" status: 204 len: 168 time: 0.1926634 Sep 03 11:37:02.770240 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a337f7-85c5-4d17-b423-83aab7dbd4a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=866ad972-c7ca-4341-867f-697a00fbbccc,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:03.367367 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff3da68-cbad-46fc-8056-7def5a6ec74d req-5fba7c0c-463d-4c27-9c12-97337dd3825b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:03.368857 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fff3da68-cbad-46fc-8056-7def5a6ec74d req-5fba7c0c-463d-4c27-9c12-97337dd3825b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0484209 Sep 03 11:37:03.405937 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fff3da68-cbad-46fc-8056-7def5a6ec74d req-15736de0-a51c-45f5-9bd0-c6c6235dff98 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310047 Sep 03 11:37:13.757265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-19fb6575-6b8d-4bc0-bc0d-9321192ba246 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0394390 Sep 03 11:37:13.794934 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:13.841464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-b10122f4-cd38-4a69-8d28-a3e301ee80bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:13.842931 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-b10122f4-cd38-4a69-8d28-a3e301ee80bb service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 1100 time: 0.0404387 Sep 03 11:37:13.959940 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-094ba326-1ccf-4140-8040-0a68f1ced822 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:13.961407 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-094ba326-1ccf-4140-8040-0a68f1ced822 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0936959 Sep 03 11:37:14.906942 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-ad811bd9-fe40-4a16-bde4-6ac89329df00 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 200 len: 1002 time: 0.0610504 Sep 03 11:37:15.726011 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-8c307588-6b01-4ad3-925e-17f282e0206e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:15.727483 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-8c307588-6b01-4ad3-925e-17f282e0206e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0485735 Sep 03 11:37:15.947340 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:37:16.658422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-5d218bbf-d59f-4edf-bc55-a1f70d21783b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:16.659895 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-5d218bbf-d59f-4edf-bc55-a1f70d21783b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0402691 Sep 03 11:37:16.753183 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-414ad7ef-2c1e-45fa-9fc1-ac8ad21cda2d service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831077 Sep 03 11:37:16.842279 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ba12425-65c5-4d64-a708-ff9e47560683 req-92c7f78e-7e40-4245-b67c-e3a7c30d2314 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816109 Sep 03 11:37:23.677234 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c0237f24-c1b1-4ad1-ab43-489cdc95c982 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:26.323414 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-813286db-c543-4f58-9709-8006ccc11468 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:26.734440 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:27.671964 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:27.907486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39788) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:28.012003 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6c1b03b2-fc49-44de-993b-697bd5a87a6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.097653 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6c1b03b2-fc49-44de-993b-697bd5a87a6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.157480 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6c1b03b2-fc49-44de-993b-697bd5a87a6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.200208 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6c1b03b2-fc49-44de-993b-697bd5a87a6a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=d691c5348efe4c198aa447ed7f7d011a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2916141 Sep 03 11:37:28.202141 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c1b03b2-fc49-44de-993b-697bd5a87a6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82087978-c448-4ed1-b2b0-4cc7c70ad735,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:28.202804 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39792) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:28.256347 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.279644 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.423396 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.425977 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:28.427143 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/82087978-c448-4ed1-b2b0-4cc7c70ad735 HTTP/1.1" status: 204 len: 168 time: 0.2233286 Sep 03 11:37:28.440948 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82087978-c448-4ed1-b2b0-4cc7c70ad735,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:28.442747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.443104 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.443447 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.443784 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.444140 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.444468 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.444851 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.445189 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.445520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.445845 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.446170 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.446518 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e543319b-c90f-4d54-8286-ec3a1b9614cb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:37:28.766424 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa7721a-61f9-4695-8730-48fdd986b4cf req-cf9ca183-43da-4256-b2a9-99e2ad12335c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:28.768007 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ffa7721a-61f9-4695-8730-48fdd986b4cf req-cf9ca183-43da-4256-b2a9-99e2ad12335c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 945 time: 0.0513732 Sep 03 11:37:28.809418 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ffa7721a-61f9-4695-8730-48fdd986b4cf req-09e992ac-29be-4598-beb9-62b228d811ae tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350013 Sep 03 11:37:29.046259 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:29.927098 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aff2d2-5dee-4ca3-b69e-5d765351d4c6 req-9e2b8719-791b-4fc1-af9e-5ef7f8a2e122 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:29.928583 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1aff2d2-5dee-4ca3-b69e-5d765351d4c6 req-9e2b8719-791b-4fc1-af9e-5ef7f8a2e122 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 945 time: 0.0483570 Sep 03 11:37:29.965505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1aff2d2-5dee-4ca3-b69e-5d765351d4c6 req-607e20af-206a-46ad-b040-8417c5314bc9 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/security-groups?id=7cbd1ac9-742a-43cf-8421-c9b8d36af842&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308757 Sep 03 11:37:30.401942 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86c1607-0d72-42bd-9273-7c204d184804 req-cf176c44-83be-4a7a-8152-31ad2eddbb6e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:30.403386 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a86c1607-0d72-42bd-9273-7c204d184804 req-cf176c44-83be-4a7a-8152-31ad2eddbb6e tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 945 time: 0.0500522 Sep 03 11:37:30.492633 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Deleting port 17908d40-6292-4dfd-8db6-648a2fa52d25 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:37:30.492633 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:30.581327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] For port 17908d40-6292-4dfd-8db6-648a2fa52d25, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=17908d40-6292-4dfd-8db6-648a2fa52d25,segment=NetworkSegment(8118ee45-fe26-4e61-b528-5af58071eb6c),segment_id=8118ee45-fe26-4e61-b528-5af58071eb6c)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:37:30.581689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:30.593213 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Calling delete_port for 17908d40-6292-4dfd-8db6-648a2fa52d25 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:37:30.823241 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:30.835445 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['17908d40-6292-4dfd-8db6-648a2fa52d25'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:37:30.854546 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Pushing event deleted for resources: {'Port': ['ID=17908d40-6292-4dfd-8db6-648a2fa52d25,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:30.893365 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] No DVR routers for this DVR port 17908d40-6292-4dfd-8db6-648a2fa52d25 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:37:30.895780 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:30.897738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a86c1607-0d72-42bd-9273-7c204d184804 req-95d26a72-1123-44cc-bd56-55c03c6de47c tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.11 "DELETE /v2.0/ports/17908d40-6292-4dfd-8db6-648a2fa52d25 HTTP/1.1" status: 204 len: 173 time: 0.4883897 Sep 03 11:37:30.904825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'name': 'network-vif-deleted', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:37:30.904825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34d3eece-3c0d-4062-ba5b-d49286530ba0" -d '{"events": [{"server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "name": "network-vif-deleted", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:37:30.936739 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:37:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b4014b4-ddc5-4ce1-9c2c-82a560087258 x-openstack-request-id: req-2b4014b4-ddc5-4ce1-9c2c-82a560087258 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:37:30.937308 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ffcc06ff-6785-4038-b153-b183913ffeb0", "name": "network-vif-deleted", "tag": "17908d40-6292-4dfd-8db6-648a2fa52d25", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:37:30.937308 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-2b4014b4-ddc5-4ce1-9c2c-82a560087258 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:37:30.937888 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ffcc06ff-6785-4038-b153-b183913ffeb0', 'name': 'network-vif-deleted', 'tag': '17908d40-6292-4dfd-8db6-648a2fa52d25', 'status': 'completed', 'code': 200} Sep 03 11:37:31.068685 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4a74fca2-e799-4c07-a183-a16f3d351b00 req-4c83a978-a379-45ca-8019-2e0926904b94 tempest-VolumesSnapshotTestJSON-694910367 tempest-VolumesSnapshotTestJSON-694910367-project] 10.222.0.16 "GET /v2.0/ports?device_id=ffcc06ff-6785-4038-b153-b183913ffeb0 HTTP/1.1" status: 200 len: 210 time: 0.0286646 Sep 03 11:37:33.825231 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 17908d40-6292-4dfd-8db6-648a2fa52d25 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:37:33.845721 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 17908d40-6292-4dfd-8db6-648a2fa52d25 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:37:33.846113 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 17908d40-6292-4dfd-8db6-648a2fa52d25 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:37:43.782852 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:48.440924 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bca6ed4-76d6-403b-87b9-e7f54142b47f req-34b3f204-aa33-4858-8142-ebb88e45db8a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:48.442460 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8bca6ed4-76d6-403b-87b9-e7f54142b47f req-34b3f204-aa33-4858-8142-ebb88e45db8a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0494664 Sep 03 11:37:48.479398 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8bca6ed4-76d6-403b-87b9-e7f54142b47f req-32116cc2-dad2-40d7-ae7a-277e791d1d55 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310726 Sep 03 11:37:49.601791 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98452f99-6b08-4b37-9384-d18b5d2deabe req-ebcf66ed-8d16-42b4-8f8b-132effa8bd60 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:49.603265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-98452f99-6b08-4b37-9384-d18b5d2deabe req-ebcf66ed-8d16-42b4-8f8b-132effa8bd60 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0523591 Sep 03 11:37:49.641295 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-98452f99-6b08-4b37-9384-d18b5d2deabe req-f5444080-d896-4023-94ec-c1e0c5b1c928 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321071 Sep 03 11:37:49.930279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-e6bbd37b-77be-46c4-a6d1-316eb78f54a2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:49.931868 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-e6bbd37b-77be-46c4-a6d1-316eb78f54a2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0477171 Sep 03 11:37:50.023798 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Deleting port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:37:50.024133 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:50.109911 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] For port ea0c67e2-065e-475f-b1ce-c182f3c8ea81, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:37:50.110267 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:50.581371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:50.581656 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:50.581965 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Floating IP 4845804a-0864-472e-90ea-80e2153aa5eb disassociated. External IP: 172.27.0.126, port: ea0c67e2-065e-475f-b1ce-c182f3c8ea81. Sep 03 11:37:50.582300 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Calling delete_port for ea0c67e2-065e-475f-b1ce-c182f3c8ea81 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:37:50.757709 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fabd4f-b777-41d5-bc6a-01930ca88aa8 req-2a77b0a9-d64a-4426-b9e5-4b8e9682e5a9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:50.759236 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-37fabd4f-b777-41d5-bc6a-01930ca88aa8 req-2a77b0a9-d64a-4426-b9e5-4b8e9682e5a9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 947 time: 0.0482080 Sep 03 11:37:50.798044 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-37fabd4f-b777-41d5-bc6a-01930ca88aa8 req-9f5f658b-ad27-4411-a2b5-ccd549b8685c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322447 Sep 03 11:37:50.799125 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:50.830460 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'Port': ['ID=ea0c67e2-065e-475f-b1ce-c182f3c8ea81,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:50.942857 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:37:51.048616 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:37:51.058084 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:37:51.070896 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:37:51.071580 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:37:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:51.091520 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] No DVR routers for this DVR port ea0c67e2-065e-475f-b1ce-c182f3c8ea81 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:37:51.094069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:51.096190 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a43e28ff-e11a-4436-bc73-3cb8c58f183d req-fed45ba1-193a-4627-86cc-6decfa7f0a46 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "DELETE /v2.0/ports/ea0c67e2-065e-475f-b1ce-c182f3c8ea81 HTTP/1.1" status: 204 len: 173 time: 1.1575668 Sep 03 11:37:51.096578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-deleted', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:37:51.098867 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40a0f2f7-0dd1-4de9-beb5-4d30971018c0" -d '{"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-deleted", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:37:51.134152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:37:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-027858e1-7f49-44e2-a89e-2af6b065be98 x-openstack-request-id: req-027858e1-7f49-44e2-a89e-2af6b065be98 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:37:51.134559 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cf874a4a-82c6-4072-a7cd-27fd97fca12e", "name": "network-vif-deleted", "tag": "ea0c67e2-065e-475f-b1ce-c182f3c8ea81", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:37:51.134777 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-027858e1-7f49-44e2-a89e-2af6b065be98 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:37:51.135169 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf874a4a-82c6-4072-a7cd-27fd97fca12e', 'name': 'network-vif-deleted', 'tag': 'ea0c67e2-065e-475f-b1ce-c182f3c8ea81', 'status': 'completed', 'code': 200} Sep 03 11:37:51.178194 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:37:51.377882 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:51.407556 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:37:51.415977 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:37:51.416577 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:37:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:51.517030 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:37:51.717817 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:51.742561 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-287861f9-57c8-43e4-bf27-498648fe79b1 None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:37:51.914694 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f6705863-ccd6-4b75-bb1d-a308b6540956 req-6255d201-7229-44f5-a47b-654cdc7bc6ca tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=cf874a4a-82c6-4072-a7cd-27fd97fca12e HTTP/1.1" status: 200 len: 210 time: 0.0302010 Sep 03 11:37:51.971882 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e760449-4560-4e0c-a60c-8e4cefd58cec None None] New status for floating IP 4845804a-0864-472e-90ea-80e2153aa5eb: DOWN {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:37:52.945346 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:37:53.078412 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 39940) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:53.136449 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.160116 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.271066 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.273566 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.274732 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "DELETE /v2.0/security-groups/6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2 HTTP/1.1" status: 204 len: 168 time: 0.1952806 Sep 03 11:37:53.282072 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39942) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:53.284320 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d06ebfd3-c0c3-4820-a918-59b8d8321f9e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:53.296204 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.api.v2.resource [None req-709c9737-54c3-4884-b1f0-a4a65e44e8f3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] show failed (client error): The resource could not be found. Sep 03 11:37:53.297224 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-709c9737-54c3-4884-b1f0-a4a65e44e8f3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups/6ceec06c-fc0f-47ff-b1f1-5d1b5f3770f2 HTTP/1.1" status: 404 len: 347 time: 0.0141392 Sep 03 11:37:53.300136 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39944) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:53.419112 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Deleting port 739df9bf-605f-429d-9edd-1b2eb50bed37 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:37:53.419504 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.496925 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.497180 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.509067 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Calling delete_port for 739df9bf-605f-429d-9edd-1b2eb50bed37 owned by network:floatingip {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:37:53.671210 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-83765ae8-df6d-4b9e-a529-8b2a5397cabf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.699833 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.727173 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'Port': ['ID=739df9bf-605f-429d-9edd-1b2eb50bed37,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:53.784857 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.787338 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:53.789786 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-b804fd23-f00f-414a-b0d0-ba2d090bd6a6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "DELETE /v2.0/floatingips/4845804a-0864-472e-90ea-80e2153aa5eb HTTP/1.1" status: 204 len: 168 time: 0.4874527 Sep 03 11:37:53.900820 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:37:53.920798 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: ea0c67e2-065e-475f-b1ce-c182f3c8ea81 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:37:53.921137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device ea0c67e2-065e-475f-b1ce-c182f3c8ea81 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:37:54.091838 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39954) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:54.096528 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1361950525', 'description': 'tempest-description--1519462077'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:37:54.188803 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.273015 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.362816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.397689 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c031e91b-afe7-4dfa-a769-3db153b555e5,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:54.471239 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.472489 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f8a02eec-956b-4a86-90be-d857ffd3fe6d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.3796430 Sep 03 11:37:54.475255 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39958) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:54.479571 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group_rule': {'security_group_id': 'c031e91b-afe7-4dfa-a769-3db153b555e5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:37:54.602003 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.658203 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.729175 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.748447 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b551b0c-115a-43b1-bce0-5b6cb3f50a63,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:54.825986 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.826216 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42458d35-7e38-4381-ac75-05492901c87e req-d986bd2d-b763-4444-8d08-4cb94db4e8b9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:54.828880 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8d9a888f-e53b-4bfa-8475-25220830d832 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3513227 Sep 03 11:37:54.829031 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-42458d35-7e38-4381-ac75-05492901c87e req-d986bd2d-b763-4444-8d08-4cb94db4e8b9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0576603 Sep 03 11:37:54.830247 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39962) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:54.834971 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'security_group_rule': {'security_group_id': 'c031e91b-afe7-4dfa-a769-3db153b555e5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:37:54.866810 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-42458d35-7e38-4381-ac75-05492901c87e req-6eee4925-38cc-42e9-87f6-1131191a40ac tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328109 Sep 03 11:37:54.923060 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:54.983416 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.082865 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.102918 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f4e917c-47f4-4b26-87e2-7ec11c2ecffd,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:55.174059 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.174059 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e3c5408f-e1ac-4574-a1f3-4e739e87600b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3391082 Sep 03 11:37:55.176716 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 39968) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:55.181354 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:37:55.277523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.375742 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.477823 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Allocated IP 172.27.0.172 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/d6e239ce-2e5a-44fb-8ea7-01ced217d242) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:37:55.583597 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.680192 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.715503 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:37:55.718456 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:37:55.721864 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:37:55.750707 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=d6e239ce-2e5a-44fb-8ea7-01ced217d242,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:55.815271 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.896839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:55.988981 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1a6c921-9367-401e-b01d-b964172952d1 req-cf1d6eef-c3e1-44fb-8082-2ad70ae33193 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:55.990411 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a1a6c921-9367-401e-b01d-b964172952d1 req-cf1d6eef-c3e1-44fb-8082-2ad70ae33193 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0544305 Sep 03 11:37:56.029702 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a1a6c921-9367-401e-b01d-b964172952d1 req-65ae2543-52f5-4e30-afc4-a02b3fd8f959 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330973 Sep 03 11:37:56.064658 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.165844 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.233297 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=d6e239ce-2e5a-44fb-8ea7-01ced217d242,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:56.244567 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.368811 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.370051 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-dd107c74-9957-4227-8d39-be5e3522516d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1923568 Sep 03 11:37:56.383008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-79e8cf0e-a5dc-43f2-bca1-4de55ae33bcd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.557945 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-53dd1680-6c87-47a2-9b2c-0f31bc19c71e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-securitygroup--1361950525&fields=id&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 267 time: 0.0343170 Sep 03 11:37:56.663195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-0869a715-0e6d-4230-93fd-0a568b8ff2de tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:56.664692 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-0869a715-0e6d-4230-93fd-0a568b8ff2de tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 817 time: 0.0992870 Sep 03 11:37:56.680375 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-be400ef5-18d3-47e1-babf-ec3cb6f19961 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/quotas/306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 375 time: 0.0093255 Sep 03 11:37:56.737276 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-9a32d773-73a1-4383-a209-585dbee3b73b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0513709 Sep 03 11:37:56.740054 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:56.834255 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-3eafbc7c-d185-4b1d-8175-4b715c9e0c43 service neutron] 10.222.0.16 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844834 Sep 03 11:37:56.924959 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-b92321ba-392d-4131-8622-d03036be2cfb service neutron] 10.222.0.16 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847039 Sep 03 11:37:57.156343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560e5869-c2e5-4e20-bb41-67967d015c31 req-8d5c281f-cde7-4e93-bdc6-7b6ab8a27b91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:57.157340 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-560e5869-c2e5-4e20-bb41-67967d015c31 req-8d5c281f-cde7-4e93-bdc6-7b6ab8a27b91 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0595949 Sep 03 11:37:57.191063 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3c0ceac6-5cae-4359-a22d-65a5a15befec req-5a8f328e-45fa-4900-b258-8f226a75752a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 210 time: 0.0327458 Sep 03 11:37:57.224657 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-560e5869-c2e5-4e20-bb41-67967d015c31 req-ff48f02c-e31c-4970-ba17-2f3338c8bdcf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562778 Sep 03 11:37:57.660269 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:57.839119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40022) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:57.887363 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Deleting subnet cb7916f5-99f8-402c-b4ad-af12c8ae4adb {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:37:57.891534 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:57.928520 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:57.968460 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.103359 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.128763 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cb7916f5-99f8-402c-b4ad-af12c8ae4adb,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:58.134045 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.135433 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-fd553946-2a34-4edb-826a-83a51c87f4e7 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/cb7916f5-99f8-402c-b4ad-af12c8ae4adb HTTP/1.1" status: 204 len: 168 time: 0.2952955 Sep 03 11:37:58.137852 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40024) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:58.210405 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.294741 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cbc9c1e3-475c-4e35-b6b0-b48b1d4dd9de req-6371d58e-dd07-4b4a-948b-f33614c0457b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 210 time: 0.0315292 Sep 03 11:37:58.301917 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.315897 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c725f14d-842c-445d-9fae-44b313e242c1']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:58.332406 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8118ee45-fe26-4e61-b528-5af58071eb6c') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:58.332754 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8118ee45-fe26-4e61-b528-5af58071eb6c') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:37:58.342019 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.356113 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.356425 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47b2e6b-67bc-4da7-aa55-555fa3b4c926 req-da556b2b-bcb1-4bb1-b218-23849d12577e tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:58.357921 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a47b2e6b-67bc-4da7-aa55-555fa3b4c926 req-da556b2b-bcb1-4bb1-b218-23849d12577e tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0558965 Sep 03 11:37:58.363141 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Releasing vlan 367 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:37:58.364624 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:37:58.365326 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:37:58.397942 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a47b2e6b-67bc-4da7-aa55-555fa3b4c926 req-8df6b58f-ea3b-45f7-87f3-f31a355094a7 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338025 Sep 03 11:37:58.491328 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.496834 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.499493 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] 10.222.0.16 "DELETE /v2.0/networks/c725f14d-842c-445d-9fae-44b313e242c1 HTTP/1.1" status: 204 len: 168 time: 0.3603129 Sep 03 11:37:58.509744 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f74c2fe-10ec-410a-a443-198d0bd23db5 admin admin] Pushing event deleted for resources: {'Network': ['ID=c725f14d-842c-445d-9fae-44b313e242c1,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:58.852807 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40032) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:58.893545 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c4fa23fd-21aa-4d74-9a02-9ef8c1422410 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=2dcf476cde84427596b9b0192490da69&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0394244 Sep 03 11:37:58.896007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40034) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:37:58.945442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:58.966038 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.080146 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.085953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.088471 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.089549 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/7cbd1ac9-742a-43cf-8421-c9b8d36af842 HTTP/1.1" status: 204 len: 168 time: 0.1925962 Sep 03 11:37:59.109174 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf636b6-46ee-4358-b43d-9d90e4d0ce4b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cbd1ac9-742a-43cf-8421-c9b8d36af842,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:37:59.187470 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-719ba57b-958e-4067-9ad7-4df86efc5280 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:59.188985 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-719ba57b-958e-4067-9ad7-4df86efc5280 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 817 time: 0.1233802 Sep 03 11:37:59.244614 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-8d7d3d0a-5d86-4ab4-a45f-58fabb2caffc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 380 time: 0.0461061 Sep 03 11:37:59.254552 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'port': {'device_id': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'admin_state_up': True, 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'security_groups': ['c031e91b-afe7-4dfa-a769-3db153b555e5']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:37:59.406735 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9317b355-5cd4-4d2a-94dc-54652e420a81 req-511654bf-f65e-4816-859a-7817343c7986 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 210 time: 0.0289447 Sep 03 11:37:59.455118 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Made reservation on behalf of 306eebd846b1470cbf044b5d93c25528 for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:37:59.459678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.581543 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e686087-910c-4c2e-9e31-bb3bc76913e3 req-396f30b4-a3d1-435a-9802-604ee2b08b8e tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:37:59.583089 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e686087-910c-4c2e-9e31-bb3bc76913e3 req-396f30b4-a3d1-435a-9802-604ee2b08b8e tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.1090727 Sep 03 11:37:59.659435 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e686087-910c-4c2e-9e31-bb3bc76913e3 req-4765bab6-2692-446c-b576-54e194cf31a1 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0702007 Sep 03 11:37:59.665251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Allocated IP 172.20.0.6 (f307cfd8-e7a3-4489-9872-541459138ccc/6a03475a-6598-4871-b0ad-65ad1f51a945/cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:37:59.800182 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.814061 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Transition to ACTIVE for port object cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:37:59.920655 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:37:59.961694 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Network f307cfd8-e7a3-4489-9872-541459138ccc is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:37:59.964768 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:37:59.968646 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:37:59.995438 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:00.024276 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:00.024897 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.135489 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-01bdb458-c1be-4d75-8dde-9ca062bec476 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8845193 Sep 03 11:38:00.148862 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Request body: {'port': {'device_id': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:38:00.211157 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.328540 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-222b70d2-7ec6-4015-8c6d-e076bfb19e23 None None] Provisioning for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:38:00.332326 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-222b70d2-7ec6-4015-8c6d-e076bfb19e23 None None] Provisioning complete for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:38:00.332693 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-222b70d2-7ec6-4015-8c6d-e076bfb19e23 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.368962 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-222b70d2-7ec6-4015-8c6d-e076bfb19e23 None None] Port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:38:00.474476 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:38:00.483354 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.517203 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Transition to ACTIVE for port object cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:38:00.536406 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc5147b-ea3a-440c-a1e2-7bd4f1d06d59 req-725f6467-b177-40ce-8cc4-65343bab2b93 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:00.537869 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5bc5147b-ea3a-440c-a1e2-7bd4f1d06d59 req-725f6467-b177-40ce-8cc4-65343bab2b93 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 931 time: 0.0570724 Sep 03 11:38:00.579439 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5bc5147b-ea3a-440c-a1e2-7bd4f1d06d59 req-2bcbff7d-2340-443d-bc9c-e4e82c74f245 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0355842 Sep 03 11:38:00.580458 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.631370 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:00.698113 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Attempting to bind port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:38:00.698548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Attempting to bind port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:38:00.698892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Attempting to bind port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:38:00.704923 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c on network f307cfd8-e7a3-4489-9872-541459138ccc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:38:00.705235 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Attempting to bind port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c on network f307cfd8-e7a3-4489-9872-541459138ccc {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:38:00.710469 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 37, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:38:00.710802 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Checking segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:38:00.711181 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Bound using segment: {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:38:00.711605 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Bound port: cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 360, 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:38:00.711961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.810144 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:38:00.813920 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:38:00.821765 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757cbcf2-69c7-49bf-a87b-bf6a488f5789 req-bee6b686-25a2-4889-8830-8bf29faa6c66 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:00.825062 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-757cbcf2-69c7-49bf-a87b-bf6a488f5789 req-bee6b686-25a2-4889-8830-8bf29faa6c66 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0785325 Sep 03 11:38:00.862495 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-757cbcf2-69c7-49bf-a87b-bf6a488f5789 req-0ebfd3a9-cac5-43c4-865e-d87dc0f0a55a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331228 Sep 03 11:38:00.883219 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.918327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:00.919062 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:00.921550 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] 10.222.0.11 "PUT /v2.0/ports/cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 1093 time: 0.7771084 Sep 03 11:38:00.921992 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:38:00.924292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d81c4d22-5359-4510-8681-d9368ac22d75" -d '{"events": [{"name": "network-changed", "server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:38:00.950765 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34ef2ee-7c01-45e2-ab71-cda3f3514885 service neutron] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:00.980320 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:38:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84838a0d-dab3-4a35-82a8-2a22ff09174d x-openstack-request-id: req-84838a0d-dab3-4a35-82a8-2a22ff09174d {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:38:00.980320 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:38:00.980320 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-84838a0d-dab3-4a35-82a8-2a22ff09174d {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:38:00.980320 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'status': 'completed', 'code': 200} Sep 03 11:38:01.041915 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-c152e892-4f96-4175-a4d6-c439c07aa1e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.043535 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-c152e892-4f96-4175-a4d6-c439c07aa1e0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1096 time: 0.0437770 Sep 03 11:38:01.145264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-27a99006-0343-4be4-b59b-db7a4ea4948b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.146773 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-27a99006-0343-4be4-b59b-db7a4ea4948b service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=306eebd846b1470cbf044b5d93c25528&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0950682 Sep 03 11:38:01.241464 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-616c1912-15cb-4e04-a806-d3355b064c37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.242966 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d81c4d22-5359-4510-8681-d9368ac22d75 req-616c1912-15cb-4e04-a806-d3355b064c37 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0896888 Sep 03 11:38:01.317191 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-d62bf385-ca2a-4195-adfe-a52e51216175 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.318681 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-d62bf385-ca2a-4195-adfe-a52e51216175 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1096 time: 0.0404234 Sep 03 11:38:01.360419 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-e3492165-929f-4b3e-bd19-f85079729a27 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 217 time: 0.0317051 Sep 03 11:38:01.407387 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-99d97986-c829-4723-b66b-2765e5daa579 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.408784 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-99d97986-c829-4723-b66b-2765e5daa579 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0417182 Sep 03 11:38:01.458288 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a38a8415-9999-4de3-901b-ae940f40441a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.459667 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-a38a8415-9999-4de3-901b-ae940f40441a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0426824 Sep 03 11:38:01.547127 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-c559116b-ada0-4013-b79c-fe715707b887 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797594 Sep 03 11:38:01.636875 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-04e89da4-d817-47b2-b127-337b5bc04a1f req-1f33c865-d9fd-4fc4-b284-9fb99687fe56 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832250 Sep 03 11:38:01.702636 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db85e600-3348-4bc8-8697-b9b564a875dd req-94d0dcc2-7cb5-483c-9578-839defb760e8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.704094 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db85e600-3348-4bc8-8697-b9b564a875dd req-94d0dcc2-7cb5-483c-9578-839defb760e8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0498259 Sep 03 11:38:01.741003 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db85e600-3348-4bc8-8697-b9b564a875dd req-83ad3852-bd01-49fd-8182-a3ca17a09147 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308781 Sep 03 11:38:01.977185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a742a85-e301-4589-8187-a2ca41af8642 req-6c2e637d-1801-44f2-aae7-3c175fd5d8d9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:01.978664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2a742a85-e301-4589-8187-a2ca41af8642 req-6c2e637d-1801-44f2-aae7-3c175fd5d8d9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0487127 Sep 03 11:38:02.019663 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2a742a85-e301-4589-8187-a2ca41af8642 req-7f6844aa-8511-452a-92d2-6a02a92fcad4 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347605 Sep 03 11:38:02.858995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edd78d3-dba0-4b85-befb-ad9a30f18444 req-d837fe5a-1491-4c74-9660-ad7179a49bfb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:02.860462 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4edd78d3-dba0-4b85-befb-ad9a30f18444 req-d837fe5a-1491-4c74-9660-ad7179a49bfb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0486519 Sep 03 11:38:02.896695 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4edd78d3-dba0-4b85-befb-ad9a30f18444 req-54e55a47-50b0-4e7d-a259-7fd131cae2c6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304468 Sep 03 11:38:03.132386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c3052d-4683-4dfd-af80-c63b42bdef2b req-8639b099-3641-41e8-b13d-984d6a675c64 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:03.133843 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-59c3052d-4683-4dfd-af80-c63b42bdef2b req-8639b099-3641-41e8-b13d-984d6a675c64 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0481193 Sep 03 11:38:03.176193 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-59c3052d-4683-4dfd-af80-c63b42bdef2b req-62783513-3681-4f2c-b4a5-a0fe3656b506 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363081 Sep 03 11:38:03.956092 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:38:04.014178 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eee68a-ac3d-4af3-aa1d-61faab71bb3f req-506ee471-b5c2-49d5-9614-e7cb7ee95c7f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:04.015459 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50eee68a-ac3d-4af3-aa1d-61faab71bb3f req-506ee471-b5c2-49d5-9614-e7cb7ee95c7f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0491683 Sep 03 11:38:04.051650 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:04.056068 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50eee68a-ac3d-4af3-aa1d-61faab71bb3f req-44886eb1-3f89-4229-adaa-ddcf6b98e786 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343184 Sep 03 11:38:04.063610 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:38:04.099550 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:04.112630 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:38:04.132221 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:04.225864 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:04.273254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:04.280216 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.280561 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.280905 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.281237 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.281570 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.281909 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.282236 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.282588 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.282916 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.283240 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.283562 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.283886 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:38:04.290160 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05462e6-a2c5-4ed6-8b3f-38f332df4f6f req-3045104e-9665-4c0c-9c4e-483e044b289d tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:04.291674 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b05462e6-a2c5-4ed6-8b3f-38f332df4f6f req-3045104e-9665-4c0c-9c4e-483e044b289d tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0486562 Sep 03 11:38:04.330345 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b05462e6-a2c5-4ed6-8b3f-38f332df4f6f req-d67d7630-909a-49a8-abd5-3c50dec68cf2 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320208 Sep 03 11:38:04.448554 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:38:05.000551 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-dbf600c7-434d-47e6-921c-4877fc74c5d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.002210 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-dbf600c7-434d-47e6-921c-4877fc74c5d9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1099 time: 0.0403392 Sep 03 11:38:05.093336 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-5dd67961-cbc5-4a19-8a33-e041795f7d9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.094839 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-5dd67961-cbc5-4a19-8a33-e041795f7d9f service neutron] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 909 time: 0.0857792 Sep 03 11:38:05.186675 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-898d97b1-fa01-4436-aff3-d26f6cada19b service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 1002 time: 0.0843377 Sep 03 11:38:05.210266 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a60a86-d0d2-4247-952a-1647ffa6e6a9 req-9f9b3f06-6683-4173-9d7e-73cb95866b6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.211702 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-88a60a86-d0d2-4247-952a-1647ffa6e6a9 req-9f9b3f06-6683-4173-9d7e-73cb95866b6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0757930 Sep 03 11:38:05.260621 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-7e21249f-3b35-4dfb-bec7-6c8463afe1d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.262017 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-7e21249f-3b35-4dfb-bec7-6c8463afe1d4 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0676713 Sep 03 11:38:05.282358 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-88a60a86-d0d2-4247-952a-1647ffa6e6a9 req-6b4ad5eb-b9bb-45a8-ac4b-8d304331604c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538852 Sep 03 11:38:05.310202 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-11500521-a7fb-46a8-abaa-76f8ee8c17ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.312940 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-11500521-a7fb-46a8-abaa-76f8ee8c17ad service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0429482 Sep 03 11:38:05.413254 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-09a3d419-972b-4724-b4db-727e155c257c service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927947 Sep 03 11:38:05.501239 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89845bee-af76-4b6d-aa54-941b5cfc893d req-b7fb364f-4fa2-44aa-b8ea-c85a3a213328 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:05.502650 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-89845bee-af76-4b6d-aa54-941b5cfc893d req-b7fb364f-4fa2-44aa-b8ea-c85a3a213328 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.1033082 Sep 03 11:38:05.546345 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83c92cd2-0d9a-4221-837b-dc4a99ccc950 req-5a0f7812-776f-4a27-8a3b-dda3197ee42c service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1189187 Sep 03 11:38:05.558787 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-89845bee-af76-4b6d-aa54-941b5cfc893d req-045ccd25-5aa8-4735-b6de-6bd1a62fc850 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455031 Sep 03 11:38:05.971166 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:38:06.082815 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:38:06.086498 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:38:06.086871 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:06.163881 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:06.187745 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:38:06.208058 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c695e1f1-4e2b-45fb-a005-36797afd3a37" -d '{"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:38:06.208058 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:06.231714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:38:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e561f094-51b6-49ab-864b-68a6b86852a7 x-openstack-request-id: req-e561f094-51b6-49ab-864b-68a6b86852a7 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:38:06.232010 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:38:06.232289 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e561f094-51b6-49ab-864b-68a6b86852a7 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:38:06.233241 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'code': 200} Sep 03 11:38:06.377205 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:06.399937 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bea0b2e-c6e5-460e-873c-4d5defa62205 req-0a49e527-690d-4340-bdf2-6cbcb37004bf tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:06.401433 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6bea0b2e-c6e5-460e-873c-4d5defa62205 req-0a49e527-690d-4340-bdf2-6cbcb37004bf tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0490847 Sep 03 11:38:06.424389 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:06.444788 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6bea0b2e-c6e5-460e-873c-4d5defa62205 req-11596a99-4842-4115-bd2f-68f539890f5e tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323794 Sep 03 11:38:06.640656 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a714d8b1-730d-4327-ab3f-5d147c77f00b req-aa043cb0-0809-4748-a804-3f951999ae8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:06.642082 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a714d8b1-730d-4327-ab3f-5d147c77f00b req-aa043cb0-0809-4748-a804-3f951999ae8b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1098 time: 0.0483820 Sep 03 11:38:06.699062 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a714d8b1-730d-4327-ab3f-5d147c77f00b req-2e47ac97-dfdc-4f02-b958-6b43244a4a3b service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375893 Sep 03 11:38:06.707880 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5983cfd-ce9a-4d5d-ba29-435c9b267cbf req-ac14687b-78e7-4d58-b71b-90fab8d30abf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:06.709287 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5983cfd-ce9a-4d5d-ba29-435c9b267cbf req-ac14687b-78e7-4d58-b71b-90fab8d30abf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0796762 Sep 03 11:38:06.745576 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f5983cfd-ce9a-4d5d-ba29-435c9b267cbf req-e4a85a69-8536-4c46-82bf-fe46aadc350e tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301688 Sep 03 11:38:07.565185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0b14fd5-cdec-45ae-b038-edcebdad83d2 req-d2571491-0135-4830-b650-7999a166e237 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:07.566732 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0b14fd5-cdec-45ae-b038-edcebdad83d2 req-d2571491-0135-4830-b650-7999a166e237 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0495460 Sep 03 11:38:07.605647 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b0b14fd5-cdec-45ae-b038-edcebdad83d2 req-d0a14195-f3da-4b66-a421-b137228dfd8b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328708 Sep 03 11:38:07.858618 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4714b7-67c8-4bfd-b914-b36657037d31 req-09d007ec-7e2e-4d04-b9f2-c9e3a14e02fa tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:07.860123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db4714b7-67c8-4bfd-b914-b36657037d31 req-09d007ec-7e2e-4d04-b9f2-c9e3a14e02fa tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0497122 Sep 03 11:38:07.897422 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-db4714b7-67c8-4bfd-b914-b36657037d31 req-51d55ce3-ee7a-4eda-8563-d9a71f29a6d5 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314641 Sep 03 11:38:08.727902 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3b6132-8969-4230-ba6c-f47e64f0b123 req-95451e77-fd33-47f1-a375-98a86555d39d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:08.729398 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d3b6132-8969-4230-ba6c-f47e64f0b123 req-95451e77-fd33-47f1-a375-98a86555d39d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0518274 Sep 03 11:38:08.766913 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d3b6132-8969-4230-ba6c-f47e64f0b123 req-ac731128-7bf3-46d6-a654-c277d9a70c4a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310996 Sep 03 11:38:08.881650 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71040f9-6970-4f56-8a98-38f18d3867a6 req-6042507b-014b-4104-b0b4-d642b9f872da tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:08.883146 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c71040f9-6970-4f56-8a98-38f18d3867a6 req-6042507b-014b-4104-b0b4-d642b9f872da tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0490785 Sep 03 11:38:08.896188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40082) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:38:08.900665 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Request body: {'floatingip': {'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:38:08.942243 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:09.325327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18708bc6-eda0-4f0c-8540-2afa11996d09 req-68e2fdda-271a-46b8-9eb8-c1586158b6b7 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:09.327475 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18708bc6-eda0-4f0c-8540-2afa11996d09 req-68e2fdda-271a-46b8-9eb8-c1586158b6b7 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.3558335 Sep 03 11:38:09.434770 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-18708bc6-eda0-4f0c-8540-2afa11996d09 req-5618f34d-ca8d-4b5c-8f03-1e71fb5dfbae tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967412 Sep 03 11:38:09.665482 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:09.738430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:09.827385 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad53615-d8aa-4901-a83a-09774e219974 req-de6dfa39-16ea-45e6-be2a-8fa0eeb541e1 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:09.828897 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ad53615-d8aa-4901-a83a-09774e219974 req-de6dfa39-16ea-45e6-be2a-8fa0eeb541e1 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.1170981 Sep 03 11:38:09.856316 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40094) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:38:09.883844 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Floating IP f577a179-7912-4343-92d7-668771fe7c89 associated. External IP: 172.27.0.172, port: cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c. Sep 03 11:38:09.889429 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ad53615-d8aa-4901-a83a-09774e219974 req-12007335-d070-4828-9d60-e5694a4d4334 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535309 Sep 03 11:38:09.945032 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-f6491b8b-81bc-417d-be3b-5ca801dacd64 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0864074 Sep 03 11:38:09.954035 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-389e9117-7c17-43ea-999c-e2449a6be46b service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94432) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:38:09.955022 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-389e9117-7c17-43ea-999c-e2449a6be46b service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052042 Sep 03 11:38:09.988135 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:38:10.068985 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:10.093329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:38:10.095700 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3cf845f-d3d2-42ae-ac24-5ffd70849d36" -d '{"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-unplugged", "status": "completed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:38:10.110555 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:10.110730 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:38:10.132101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 03 Sep 2021 11:38:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca2cc8a9-c86e-4095-8e66-e7b1704b6d35 x-openstack-request-id: req-ca2cc8a9-c86e-4095-8e66-e7b1704b6d35 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:38:10.132626 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-unplugged", "status": "failed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "code": 422}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:38:10.133049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ca2cc8a9-c86e-4095-8e66-e7b1704b6d35 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:38:10.133587 dv-cinder-760199-12-iscsi neutron-server[94434]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'code': 422} returned with failed status Sep 03 11:38:10.208540 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:10.221755 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:38:10.226760 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:10.233773 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:38:10.244853 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:38:10.246875 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:37:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:38:10.260779 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-af7cb263-c750-47bf-8681-d935cdec475d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "PUT /v2.0/floatingips/f577a179-7912-4343-92d7-668771fe7c89 HTTP/1.1" status: 200 len: 991 time: 1.3635478 Sep 03 11:38:10.261476 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:38:10.264499 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e27b9a51-2a17-4ae0-8346-921a6a959087" -d '{"events": [{"name": "network-changed", "server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:38:10.265041 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=6']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:10.314230 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:38:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cf3e31b3-dcfc-4380-8369-baa859b01a09 x-openstack-request-id: req-cf3e31b3-dcfc-4380-8369-baa859b01a09 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:38:10.314692 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:38:10.314944 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-cf3e31b3-dcfc-4380-8369-baa859b01a09 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:38:10.315341 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'status': 'completed', 'code': 200} Sep 03 11:38:10.374843 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-3ab231a7-6640-4753-9be9-8ca31d2e8a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:10.376355 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-3ab231a7-6640-4753-9be9-8ca31d2e8a4e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1098 time: 0.0502563 Sep 03 11:38:10.383359 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:38:10.483501 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-15574b10-1c8b-429c-a6e8-992df25f3340 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:10.485119 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-15574b10-1c8b-429c-a6e8-992df25f3340 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.1016324 Sep 03 11:38:10.551622 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-377eeb6d-76eb-4470-8a34-7a9973aa7712 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 999 time: 0.0595798 Sep 03 11:38:10.603378 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-414a1104-20b5-49a4-af8e-a92ffe2d32b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:10.604843 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-414a1104-20b5-49a4-af8e-a92ffe2d32b2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0456021 Sep 03 11:38:10.655523 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-f6344ac8-3f6d-4dd6-a8be-3f3e4fdf0b6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:10.657159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-f6344ac8-3f6d-4dd6-a8be-3f3e4fdf0b6c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0446520 Sep 03 11:38:10.699519 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'f577a179-7912-4343-92d7-668771fe7c89', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.172', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:37:55Z', 'updated_at': '2021-09-03T11:38:09Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:38:10.726694 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:38:10.736665 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:38:10.737273 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:37:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:38:10.763984 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-544b231d-9e9a-40f1-8150-0f43eebc2bd1 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923254 Sep 03 11:38:10.843107 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:38:10.858067 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e27b9a51-2a17-4ae0-8346-921a6a959087 req-f5cd3171-0ca2-4eb1-9ae1-5cee2dd971d1 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878084 Sep 03 11:38:11.008128 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02572d9-9d2d-46a9-81df-42c7a4e05ac7 req-4bdbb14b-76c9-44d4-a2d7-eb2638129525 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:11.009660 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d02572d9-9d2d-46a9-81df-42c7a4e05ac7 req-4bdbb14b-76c9-44d4-a2d7-eb2638129525 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0511317 Sep 03 11:38:11.048991 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d02572d9-9d2d-46a9-81df-42c7a4e05ac7 req-eef71e65-7cba-4a14-8aee-14f7d1b291e5 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330880 Sep 03 11:38:11.070907 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'f577a179-7912-4343-92d7-668771fe7c89', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.172', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:37:55Z', 'updated_at': '2021-09-03T11:38:09Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:38:11.099101 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ed54bcf-f81a-49d8-95c9-5229fdab70ba None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'f577a179-7912-4343-92d7-668771fe7c89', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'floating_ip_address': '172.27.0.172', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 594, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:37:55Z', 'updated_at': '2021-09-03T11:38:09Z', 'revision_number': 1, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:38:11.277278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58c82298-bf34-42c7-a267-d512d348730e None None] New status for floating IP f577a179-7912-4343-92d7-668771fe7c89: ACTIVE {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:38:12.167841 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd80a39a-4161-4d54-9a49-ac6bbff85ac1 req-f10547a9-dca4-4803-8c6f-2f27ca62ba7b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.169319 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd80a39a-4161-4d54-9a49-ac6bbff85ac1 req-f10547a9-dca4-4803-8c6f-2f27ca62ba7b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0478280 Sep 03 11:38:12.212659 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-cd80a39a-4161-4d54-9a49-ac6bbff85ac1 req-5a0ecc8f-eac1-4cb4-b674-ca190c7accba tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0365493 Sep 03 11:38:12.463525 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-c93c3763-58de-445c-8c27-a4a7f92d594b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.464973 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-c93c3763-58de-445c-8c27-a4a7f92d594b service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b&tenant_id=f29a932166fe443d8e6a5014f9de527d HTTP/1.1" status: 200 len: 1097 time: 0.0412788 Sep 03 11:38:12.523391 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-053b020b-20a3-487b-a293-26d801e32071 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.524404 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-053b020b-20a3-487b-a293-26d801e32071 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1097 time: 0.0400922 Sep 03 11:38:12.629261 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-f377f2cb-4139-4c6d-a0f4-7d6491f0d6ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.630725 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-f377f2cb-4139-4c6d-a0f4-7d6491f0d6ad service neutron] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 909 time: 0.0865631 Sep 03 11:38:12.700462 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-f0f9c276-4d1b-4d51-8698-14c7acd37f98 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 1000 time: 0.0569088 Sep 03 11:38:12.748691 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-1d9180c8-6769-4f40-8ac8-2f34543e2117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.750037 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-1d9180c8-6769-4f40-8ac8-2f34543e2117 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0428059 Sep 03 11:38:12.798078 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-89ebab7e-07ae-432a-8a8d-50135fe1bdc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:12.799553 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-89ebab7e-07ae-432a-8a8d-50135fe1bdc3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0430667 Sep 03 11:38:12.886748 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-ddf77e74-7d81-43f7-a9ed-8b4183124f42 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798924 Sep 03 11:38:12.979117 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-39895edd-1a75-4125-8ad8-072502e5e6d7 req-6f59c985-ff1b-4185-966f-ff2a3083e8c2 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848548 Sep 03 11:38:13.115560 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-6fe51994-4300-46a0-97a4-f2835ee47179 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:13.116931 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-6fe51994-4300-46a0-97a4-f2835ee47179 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1097 time: 0.0414026 Sep 03 11:38:13.210023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-209c63d8-c288-47fe-837a-c78da2d8d40e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:13.211626 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-209c63d8-c288-47fe-837a-c78da2d8d40e service neutron] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 909 time: 0.0878944 Sep 03 11:38:13.276139 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-2b835580-5861-4b60-b1cc-8545aa164611 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 1000 time: 0.0566125 Sep 03 11:38:13.352368 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-721d1c1c-5cfb-4dc5-9590-5f5d815ea015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:13.353878 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-721d1c1c-5cfb-4dc5-9590-5f5d815ea015 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0663445 Sep 03 11:38:13.362691 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec37c91-7532-4a04-b8cb-492bd70a8165 req-38eb4409-2265-41c8-8024-ae876c0f237c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:13.364047 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dec37c91-7532-4a04-b8cb-492bd70a8165 req-38eb4409-2265-41c8-8024-ae876c0f237c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0857897 Sep 03 11:38:13.422535 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dec37c91-7532-4a04-b8cb-492bd70a8165 req-55ce143f-680a-4028-b029-3efc943b6394 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503089 Sep 03 11:38:13.427698 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-3e4d474a-55b7-45bd-8e52-20145f657412 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:13.429114 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-3e4d474a-55b7-45bd-8e52-20145f657412 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0642509 Sep 03 11:38:13.521200 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-1a7b4e0f-6f91-4faf-bce3-39a71d5d3ca8 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842247 Sep 03 11:38:13.609736 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-af19407c-2e97-4eb2-85bf-5a842b27af29 req-532698f6-58bb-4307-b19b-a58d834158e6 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810087 Sep 03 11:38:13.787817 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:14.538265 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea9d3d4-e47a-4bca-89d1-6732de497377 req-acf72d7f-a7a4-4943-bc79-d7ad2ba023fe tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:14.539781 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eea9d3d4-e47a-4bca-89d1-6732de497377 req-acf72d7f-a7a4-4943-bc79-d7ad2ba023fe tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0497985 Sep 03 11:38:14.580777 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-eea9d3d4-e47a-4bca-89d1-6732de497377 req-79d60ee8-bae0-4f91-a304-431af75c2982 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350826 Sep 03 11:38:15.694754 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886596ec-1e86-4c91-b749-c0a9ec172641 req-a481f512-73d8-4c38-b9ac-d7397e10fbfb tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:15.696265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-886596ec-1e86-4c91-b749-c0a9ec172641 req-a481f512-73d8-4c38-b9ac-d7397e10fbfb tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0496857 Sep 03 11:38:15.734153 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-886596ec-1e86-4c91-b749-c0a9ec172641 req-a5b6be69-dc3c-45fe-80f9-9b37d3e0ac48 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314164 Sep 03 11:38:16.855028 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c569f202-4972-4411-bbab-50bae5502524 req-e5beb4a5-34bb-40ed-929d-5866df32858c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:16.856604 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c569f202-4972-4411-bbab-50bae5502524 req-e5beb4a5-34bb-40ed-929d-5866df32858c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0551682 Sep 03 11:38:16.895609 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c569f202-4972-4411-bbab-50bae5502524 req-ac816db2-c95e-4d5a-9fba-827ef869aeba tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330629 Sep 03 11:38:18.011525 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a56da4d-5fb4-44fa-a1fc-318b44d0e038 req-6405e545-ca46-4cac-8542-924569093710 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:18.013002 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5a56da4d-5fb4-44fa-a1fc-318b44d0e038 req-6405e545-ca46-4cac-8542-924569093710 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0491736 Sep 03 11:38:18.053751 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5a56da4d-5fb4-44fa-a1fc-318b44d0e038 req-93f2a37b-e67f-421e-90dc-e7b72459ad6a tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341287 Sep 03 11:38:19.167493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c708630-d827-4a74-bd52-fc69ded63e0a req-662b28be-ab1e-4200-9f5f-c804a77bb5ba tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:19.168999 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7c708630-d827-4a74-bd52-fc69ded63e0a req-662b28be-ab1e-4200-9f5f-c804a77bb5ba tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 944 time: 0.0486572 Sep 03 11:38:19.210580 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7c708630-d827-4a74-bd52-fc69ded63e0a req-ef1c7b8b-4ec0-4cb3-b8df-1e87ed8e4168 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354466 Sep 03 11:38:20.004606 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:38:20.099685 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:20.111299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'f6f00829-c3b2-4786-8501-3542b436780c', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'port_id': 'f6f00829-c3b2-4786-8501-3542b436780c', 'mac_address': 'fa:16:3e:f9:c0:ca', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 397, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:38:20.149542 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:20.162532 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6f00829-c3b2-4786-8501-3542b436780c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:38:20.181406 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:20.250793 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:20.298397 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=7']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:20.325926 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be715b89-5b8a-43f0-b6b3-04c207418024 req-7e1b6414-2f35-4bdb-9f53-a8969669b6a4 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:20.327505 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be715b89-5b8a-43f0-b6b3-04c207418024 req-7e1b6414-2f35-4bdb-9f53-a8969669b6a4 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 945 time: 0.0493262 Sep 03 11:38:20.364412 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be715b89-5b8a-43f0-b6b3-04c207418024 req-b06d32ec-29f2-4daf-9cca-7d180c5c1362 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310659 Sep 03 11:38:20.460431 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['f6f00829-c3b2-4786-8501-3542b436780c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:38:21.473583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77d7205-c02a-49b1-b1b9-89a8d3ebc099 req-304f2724-ab5a-4178-a277-020fa65f91c6 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:21.475079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d77d7205-c02a-49b1-b1b9-89a8d3ebc099 req-304f2724-ab5a-4178-a277-020fa65f91c6 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 945 time: 0.0475833 Sep 03 11:38:21.516221 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d77d7205-c02a-49b1-b1b9-89a8d3ebc099 req-913651c7-59d2-47e4-8ec5-26053c2e902d tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353532 Sep 03 11:38:22.019525 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:38:22.066447 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port f6f00829-c3b2-4786-8501-3542b436780c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:38:22.066865 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:22.143405 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:22.165514 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:38:22.167789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bae5de61-abcc-46dd-80fa-172bbbd737eb" -d '{"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-plugged", "status": "completed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:38:22.180321 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:38:22.209758 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:38:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c74d874d-dd95-4b22-a0a7-fc912b978b98 x-openstack-request-id: req-c74d874d-dd95-4b22-a0a7-fc912b978b98 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:38:22.210052 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-plugged", "status": "completed", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:38:22.210306 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c74d874d-dd95-4b22-a0a7-fc912b978b98 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:38:22.210729 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'code': 200} Sep 03 11:38:22.256392 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:22.304834 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=8']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:38:22.467738 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e322aca5-4f81-41c2-aae8-bd97c17b6b84 req-60796ff9-04ca-4f71-b19d-2e13686050af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:22.469214 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e322aca5-4f81-41c2-aae8-bd97c17b6b84 req-60796ff9-04ca-4f71-b19d-2e13686050af service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1099 time: 0.0402586 Sep 03 11:38:22.502728 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e322aca5-4f81-41c2-aae8-bd97c17b6b84 req-92a31cc2-f0be-4206-a59b-a72168d6fbb6 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0268157 Sep 03 11:38:22.630770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2577772f-f6ca-49a8-9767-b4ad000c08c7 req-2e23d57e-6001-44ac-ba8c-20d22d5648c4 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:22.632148 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2577772f-f6ca-49a8-9767-b4ad000c08c7 req-2e23d57e-6001-44ac-ba8c-20d22d5648c4 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0489569 Sep 03 11:38:22.670034 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2577772f-f6ca-49a8-9767-b4ad000c08c7 req-4f95b723-db79-496c-91f5-893480412f27 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320830 Sep 03 11:38:23.679601 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c74fc03f-8d4e-4702-8448-e8aadd8ed3d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:23.786750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10b052b-c156-4ce2-9d53-7d4f2d4fe440 req-704aaa3c-26f0-47aa-adb0-9a70409f47b1 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:23.788291 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d10b052b-c156-4ce2-9d53-7d4f2d4fe440 req-704aaa3c-26f0-47aa-adb0-9a70409f47b1 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0503366 Sep 03 11:38:23.830109 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d10b052b-c156-4ce2-9d53-7d4f2d4fe440 req-afc0dca3-a546-4a10-99a4-17b6b0f9dc33 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357728 Sep 03 11:38:24.944676 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef4477-b547-4151-a33f-93d0255d9fb8 req-1a01a503-e156-4d20-b02b-2fcc261348ee tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:24.946127 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46ef4477-b547-4151-a33f-93d0255d9fb8 req-1a01a503-e156-4d20-b02b-2fcc261348ee tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0496666 Sep 03 11:38:24.984152 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-46ef4477-b547-4151-a33f-93d0255d9fb8 req-f69d3f24-f25c-4b1d-ad06-bac44275c5d5 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315747 Sep 03 11:38:26.347904 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5dc4e70-c5a5-4250-a1e9-1354b5392ab1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:26.711202 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:27.662149 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:29.102157 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:29.944129 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:38:43.793322 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:52.513913 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a542a52-f4a0-454c-9ccf-31f518d5c8f4 req-8d9067f6-8d44-480e-a81c-7ff4f426f6e1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:52.515552 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9a542a52-f4a0-454c-9ccf-31f518d5c8f4 req-8d9067f6-8d44-480e-a81c-7ff4f426f6e1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0502608 Sep 03 11:38:52.552204 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9a542a52-f4a0-454c-9ccf-31f518d5c8f4 req-58097e4e-1051-418b-b72d-05e07aa1a0cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308230 Sep 03 11:38:53.667506 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-30578c0f-9ee0-4ae6-9563-c0bcecea3e6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:53.673442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b66744-55a8-403e-9ba8-aa3b348ad44d req-e3473aaf-b5b3-4459-956a-3a26d561e624 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:53.674944 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43b66744-55a8-403e-9ba8-aa3b348ad44d req-e3473aaf-b5b3-4459-956a-3a26d561e624 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0478549 Sep 03 11:38:53.717501 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-43b66744-55a8-403e-9ba8-aa3b348ad44d req-a56d695d-5e8a-4353-a21f-531d04675808 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0365171 Sep 03 11:38:54.835331 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121ef99d-7341-4843-a3a6-c79b380c497b req-4d827f3e-d647-48ac-820b-15f98a9f5274 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:54.836796 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-121ef99d-7341-4843-a3a6-c79b380c497b req-4d827f3e-d647-48ac-820b-15f98a9f5274 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0487199 Sep 03 11:38:54.874837 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-121ef99d-7341-4843-a3a6-c79b380c497b req-b7885796-398d-426e-8fa4-64011f892bcf tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319955 Sep 03 11:38:55.993147 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50547904-cc38-4169-a7d8-3a6dda1143b4 req-56b190d3-c532-455f-846d-7fe0fb99bdac tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:55.994643 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50547904-cc38-4169-a7d8-3a6dda1143b4 req-56b190d3-c532-455f-846d-7fe0fb99bdac tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0491221 Sep 03 11:38:56.032540 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50547904-cc38-4169-a7d8-3a6dda1143b4 req-8b505224-377e-4498-a14e-fb3f6acc51c2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310886 Sep 03 11:38:56.322100 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-961c3098-e283-4b46-b02e-c8969dc99c39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:56.701530 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:57.147175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43bede0-1eb9-4d8d-9845-e1fa8c041347 req-9828370c-b684-4387-b606-243bdf153cf0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:57.148647 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d43bede0-1eb9-4d8d-9845-e1fa8c041347 req-9828370c-b684-4387-b606-243bdf153cf0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0475183 Sep 03 11:38:57.190490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d43bede0-1eb9-4d8d-9845-e1fa8c041347 req-c884d37b-f96f-4d8f-91d5-1188de9d7bff tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359299 Sep 03 11:38:57.684645 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:58.307167 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c26c21-9cf1-4eb4-b4ed-04694cb29f25 req-03f23208-243e-4fb4-b048-7681fa34195d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:58.308869 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06c26c21-9cf1-4eb4-b4ed-04694cb29f25 req-03f23208-243e-4fb4-b048-7681fa34195d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0482724 Sep 03 11:38:58.346271 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-06c26c21-9cf1-4eb4-b4ed-04694cb29f25 req-93bbe2fd-04a6-4573-a698-719269d544ad tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309377 Sep 03 11:38:59.067125 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:38:59.463510 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc05f4c-5955-4fb7-bf99-6e4f601ba66b req-d0855bb3-b9ff-4200-b2cb-f3c4d1437fbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:38:59.464975 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cc05f4c-5955-4fb7-bf99-6e4f601ba66b req-d0855bb3-b9ff-4200-b2cb-f3c4d1437fbb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0483966 Sep 03 11:38:59.502229 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cc05f4c-5955-4fb7-bf99-6e4f601ba66b req-c2240034-e7e9-4b16-8260-34189af79af0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312665 Sep 03 11:39:00.616611 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb575013-00a3-46b7-8fae-35ca902057a0 req-9b587f11-0d3e-4a47-b07e-31f35bfb05db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:00.618052 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bb575013-00a3-46b7-8fae-35ca902057a0 req-9b587f11-0d3e-4a47-b07e-31f35bfb05db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0468941 Sep 03 11:39:00.658906 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bb575013-00a3-46b7-8fae-35ca902057a0 req-465d2605-2bb1-4a2b-9c91-569831d7eac1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0350416 Sep 03 11:39:01.774646 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19a4290-fbfe-43cd-a040-e7d4abc65dae req-0e451cdb-8ca0-4906-92f2-c4f52ea82e5d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:01.776085 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f19a4290-fbfe-43cd-a040-e7d4abc65dae req-0e451cdb-8ca0-4906-92f2-c4f52ea82e5d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0474081 Sep 03 11:39:01.813871 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f19a4290-fbfe-43cd-a040-e7d4abc65dae req-b71f9340-a69d-4620-98a0-fa1b96b73e13 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307100 Sep 03 11:39:02.935059 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149d0d9a-8746-436c-a983-04f0e731f116 req-bfc6bab7-8a4b-4c7e-aae0-1436e71c6068 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:02.936796 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-149d0d9a-8746-436c-a983-04f0e731f116 req-bfc6bab7-8a4b-4c7e-aae0-1436e71c6068 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0499005 Sep 03 11:39:02.973914 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-149d0d9a-8746-436c-a983-04f0e731f116 req-a39f7263-0b77-4b55-a899-cac0fb9bea70 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309823 Sep 03 11:39:04.090467 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d484c18-6550-457a-8769-0e16125a249a req-97f2f677-d269-4233-8338-18df2a89585f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:04.091927 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d484c18-6550-457a-8769-0e16125a249a req-97f2f677-d269-4233-8338-18df2a89585f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0479138 Sep 03 11:39:04.132552 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6d484c18-6550-457a-8769-0e16125a249a req-1bf4f437-aa4f-4812-9b7a-b8676a0e9c68 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342305 Sep 03 11:39:04.156740 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:39:04.251791 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:04.262774 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:39:04.299227 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:04.314803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:39:04.333420 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:04.409749 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:04.458957 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=6']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:04.465800 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.466150 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.466518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.466856 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.467186 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.467516 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.467842 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.468166 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.468491 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.468812 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.469666 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.469984 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:04.516792 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:39:05.252962 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1187cc09-1dde-4c87-8a04-2e3c51ea4c2b req-23727d25-8cdf-4a93-9efc-5dedf9b263db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:05.254512 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1187cc09-1dde-4c87-8a04-2e3c51ea4c2b req-23727d25-8cdf-4a93-9efc-5dedf9b263db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0517969 Sep 03 11:39:05.310021 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1187cc09-1dde-4c87-8a04-2e3c51ea4c2b req-9893a794-8129-488f-84a7-72df01264b1d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491388 Sep 03 11:39:06.168823 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:39:06.232647 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:06.233022 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:06.322722 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:06.350694 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:39:06.352880 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6275ed27-546f-465b-9520-848885fca38f" -d '{"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:39:06.394201 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:06.406206 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:39:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6394ab77-c6a2-4662-b079-e03c212c2245 x-openstack-request-id: req-6394ab77-c6a2-4662-b079-e03c212c2245 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:39:06.417289 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:39:06.417289 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-6394ab77-c6a2-4662-b079-e03c212c2245 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:39:06.417289 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'code': 200} Sep 03 11:39:06.466720 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d88bb3-6ef5-4b95-890b-a5961680885e req-f8aebf90-503f-4caf-aaeb-607fd752092c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:06.467270 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:06.470517 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79d88bb3-6ef5-4b95-890b-a5961680885e req-f8aebf90-503f-4caf-aaeb-607fd752092c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0631714 Sep 03 11:39:06.530009 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=7']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:06.534743 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-79d88bb3-6ef5-4b95-890b-a5961680885e req-83057bc3-473d-4e51-848d-7cd5a2e015a8 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506387 Sep 03 11:39:06.943871 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:39:07.679669 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39f0696-a5be-4d55-97e4-c9c586f42cc6 req-1e11dfc9-2246-4e7f-9474-f7ef43e0ab4a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:07.681343 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a39f0696-a5be-4d55-97e4-c9c586f42cc6 req-1e11dfc9-2246-4e7f-9474-f7ef43e0ab4a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0720432 Sep 03 11:39:07.731737 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a39f0696-a5be-4d55-97e4-c9c586f42cc6 req-3b64ba79-ec6f-47ae-a9f5-028fa7bb8016 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413446 Sep 03 11:39:08.872676 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e650df3-d004-4dc3-8963-d8560fb317a7 req-be81ace6-78de-4f56-9634-500e1b19f2f0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:08.874170 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e650df3-d004-4dc3-8963-d8560fb317a7 req-be81ace6-78de-4f56-9634-500e1b19f2f0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0576437 Sep 03 11:39:08.930966 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e650df3-d004-4dc3-8963-d8560fb317a7 req-fed12ab9-0e29-4541-9b3a-0a44977c2970 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467131 Sep 03 11:39:10.062705 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f57cb4-6e4c-4620-9dbe-981ecacb9157 req-cb946b8f-3535-42c8-a125-d7f2954afdf0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:10.064916 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12f57cb4-6e4c-4620-9dbe-981ecacb9157 req-cb946b8f-3535-42c8-a125-d7f2954afdf0 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0524485 Sep 03 11:39:10.108159 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-12f57cb4-6e4c-4620-9dbe-981ecacb9157 req-8c56c251-6f0d-4a50-a339-6d94f3ae3254 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359800 Sep 03 11:39:11.240341 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe12faf7-8515-4fcb-ba1c-75a39878d083 req-57046fe3-33e0-4062-8b25-b18410b2a745 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:11.241748 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fe12faf7-8515-4fcb-ba1c-75a39878d083 req-57046fe3-33e0-4062-8b25-b18410b2a745 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0498393 Sep 03 11:39:11.285709 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-fe12faf7-8515-4fcb-ba1c-75a39878d083 req-6176cac1-cc88-44a3-8ce4-3964b7068017 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379605 Sep 03 11:39:12.423137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2962024b-c771-4573-8f02-fd68564afe8a req-c60f6201-7ac8-4396-8813-743009aa74ab tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:12.424731 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2962024b-c771-4573-8f02-fd68564afe8a req-c60f6201-7ac8-4396-8813-743009aa74ab tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0571761 Sep 03 11:39:12.467420 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2962024b-c771-4573-8f02-fd68564afe8a req-0683ad13-7c95-4932-ba92-5e88c5c7cabf tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362153 Sep 03 11:39:13.601273 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcde4172-3379-4995-8dc9-60baeae1a137 req-7458e744-6b1e-41b3-9d26-d750d9be02d9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:13.602842 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dcde4172-3379-4995-8dc9-60baeae1a137 req-7458e744-6b1e-41b3-9d26-d750d9be02d9 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0557036 Sep 03 11:39:13.644917 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dcde4172-3379-4995-8dc9-60baeae1a137 req-408fc306-f05b-48b1-8652-4e6fe834093c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0358701 Sep 03 11:39:13.804688 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:14.771251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dad7213-3b9d-494c-82f6-ff856d078562 req-4d781d3d-7d0e-4948-a164-9e10f0e7f98d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:14.773222 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6dad7213-3b9d-494c-82f6-ff856d078562 req-4d781d3d-7d0e-4948-a164-9e10f0e7f98d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0528936 Sep 03 11:39:14.820648 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6dad7213-3b9d-494c-82f6-ff856d078562 req-b8a83e54-df43-45a2-8e27-ea3bc246f7a2 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413511 Sep 03 11:39:15.939454 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f24ea0c-1838-4c16-8633-9efc89fa17d2 req-bfa52292-488c-401b-b93c-f11aec150887 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:15.940921 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f24ea0c-1838-4c16-8633-9efc89fa17d2 req-bfa52292-488c-401b-b93c-f11aec150887 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0495577 Sep 03 11:39:15.978624 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f24ea0c-1838-4c16-8633-9efc89fa17d2 req-c21d2571-55f4-425f-9bd3-24e95ecd58ad tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318205 Sep 03 11:39:16.303653 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-a84ef07d-c9ca-455d-b469-45ae85e68aec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:16.305171 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-a84ef07d-c9ca-455d-b469-45ae85e68aec service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1098 time: 0.0423014 Sep 03 11:39:16.395455 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-8fa38ac1-7fa4-4770-a238-f7aa495574ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:16.396859 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-8fa38ac1-7fa4-4770-a238-f7aa495574ca service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0849011 Sep 03 11:39:16.462707 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-d12df7e0-d85f-4610-b647-36335e22f223 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 1001 time: 0.0567918 Sep 03 11:39:16.515168 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-768b7bbd-144a-473a-9003-a0a39eae4c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:16.516674 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-768b7bbd-144a-473a-9003-a0a39eae4c71 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0474589 Sep 03 11:39:16.567234 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-b867c968-c1ad-4b86-9e42-11b4949a5b13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:16.568678 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-b867c968-c1ad-4b86-9e42-11b4949a5b13 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0425339 Sep 03 11:39:16.655544 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-057a0a71-b609-4012-adf8-e1c7addba44f service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792911 Sep 03 11:39:17.013550 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9e0cb932-a1c2-4c17-839e-313c9488f8ad req-0c8ea6a7-c26c-4d77-9a73-a7f4089fdf91 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3497303 Sep 03 11:39:17.094803 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6f81a1-43a3-42a7-ab31-906638c93d89 req-fe4abb71-ea6e-476b-a81b-9979f757aa0c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:17.096769 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec6f81a1-43a3-42a7-ab31-906638c93d89 req-fe4abb71-ea6e-476b-a81b-9979f757aa0c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0485463 Sep 03 11:39:17.135362 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ec6f81a1-43a3-42a7-ab31-906638c93d89 req-102b5ace-716e-4f39-8995-6e34bb42fcf6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321283 Sep 03 11:39:18.252795 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df5d7c78-ebe6-4d81-a1bb-a22d7cd3a485 req-5549f589-f1bb-4e58-a366-26a654d99bdd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:18.254232 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-df5d7c78-ebe6-4d81-a1bb-a22d7cd3a485 req-5549f589-f1bb-4e58-a366-26a654d99bdd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0476303 Sep 03 11:39:18.294036 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-df5d7c78-ebe6-4d81-a1bb-a22d7cd3a485 req-ce45c8bc-bb76-4d45-aa87-f079f1745607 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340407 Sep 03 11:39:19.418656 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d617f97-2873-400b-9170-9a24de8d308f req-55c94a53-10d7-4163-90b7-655f65f4a540 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:19.420250 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4d617f97-2873-400b-9170-9a24de8d308f req-55c94a53-10d7-4163-90b7-655f65f4a540 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 945 time: 0.0506487 Sep 03 11:39:19.458102 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4d617f97-2873-400b-9170-9a24de8d308f req-345aeacf-52ae-48ac-90ef-5d968ee11166 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320368 Sep 03 11:39:20.231305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:20.305107 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:20.327086 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:39:20.329328 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f2a93bf-8097-4320-bd06-6a0339ee7142" -d '{"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-unplugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:39:20.342714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:20.361127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 03 Sep 2021 11:39:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-148e9104-634d-453d-8d7b-55effcade4c6 x-openstack-request-id: req-148e9104-634d-453d-8d7b-55effcade4c6 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:39:20.362032 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-unplugged", "status": "failed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "code": 422}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:39:20.362287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-148e9104-634d-453d-8d7b-55effcade4c6 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:39:20.362715 dv-cinder-760199-12-iscsi neutron-server[94434]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'code': 422} returned with failed status Sep 03 11:39:20.436361 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:20.492331 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=8']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:21.485864 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c59db20-fcf9-43fd-81e1-f0c3b20af33e req-e716d685-23cc-4b3b-aff9-7a5d53a0c146 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:21.487588 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2c59db20-fcf9-43fd-81e1-f0c3b20af33e req-e716d685-23cc-4b3b-aff9-7a5d53a0c146 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0494699 Sep 03 11:39:21.530085 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2c59db20-fcf9-43fd-81e1-f0c3b20af33e req-36bd7ed1-5bf4-4fb4-8049-525c60944883 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347893 Sep 03 11:39:21.687560 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-5f761f04-1e8c-4cb7-bb3f-41f0958c2905 service neutron] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0439091 Sep 03 11:39:22.648024 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff651ef-1a48-474e-a271-1e9e88db1861 req-fe26fbd7-ad39-4092-b85d-6da2c4922b74 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:22.649613 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ff651ef-1a48-474e-a271-1e9e88db1861 req-fe26fbd7-ad39-4092-b85d-6da2c4922b74 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0478542 Sep 03 11:39:22.691548 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7ff651ef-1a48-474e-a271-1e9e88db1861 req-7c8ccada-56c1-43bb-8ce4-090153dd5d3b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359430 Sep 03 11:39:22.904076 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-5e17878c-386d-4228-b2cc-d140b7d1a69e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:22.905424 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-5e17878c-386d-4228-b2cc-d140b7d1a69e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a&tenant_id=306eebd846b1470cbf044b5d93c25528 HTTP/1.1" status: 200 len: 1096 time: 0.0393279 Sep 03 11:39:22.965363 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-e2e840ea-4ece-4a2d-9d5a-2196e62f1331 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:22.966875 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-e2e840ea-4ece-4a2d-9d5a-2196e62f1331 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1096 time: 0.0406249 Sep 03 11:39:23.057386 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-3acfc59a-ca06-45d2-bbaf-1c074ec22073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:23.058855 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-3acfc59a-ca06-45d2-bbaf-1c074ec22073 service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0851893 Sep 03 11:39:23.121804 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-3148a465-9e78-40fd-b9ae-c5e33d59dc0e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 999 time: 0.0562308 Sep 03 11:39:23.169166 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-37fb7c35-90ed-4f1b-bef6-29d877bb3016 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:23.170655 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-37fb7c35-90ed-4f1b-bef6-29d877bb3016 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0417712 Sep 03 11:39:23.218191 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-aad580c3-7dc7-40b1-aa90-5916b33b51cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:23.219686 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-aad580c3-7dc7-40b1-aa90-5916b33b51cf service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0424089 Sep 03 11:39:23.307910 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-ebbd0676-70a3-48ef-8fa8-9a0402f99335 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799642 Sep 03 11:39:23.397698 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b759507a-7bf8-4c3c-9dbe-ff8f2bf64dcd req-23f5e9ba-49a5-4699-ad6a-4a808decb58c service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832515 Sep 03 11:39:23.661186 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5e348a5a-d4a9-4eda-9fa0-73b0703bb014 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:23.811641 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bfd476-44d9-4278-9e5f-b85c700515d5 req-3f7cf5f0-6d4d-4211-a574-f52443a239ee tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:23.813123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-03bfd476-44d9-4278-9e5f-b85c700515d5 req-3f7cf5f0-6d4d-4211-a574-f52443a239ee tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0500121 Sep 03 11:39:23.850947 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-03bfd476-44d9-4278-9e5f-b85c700515d5 req-23fdfbe9-118c-4f30-821e-0627149874da tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317383 Sep 03 11:39:24.980123 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a2a5fb-4047-404b-9787-82a3ae2dd916 req-73e7b9b7-f728-47c8-94e7-07fdac0e98c3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:24.981664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a2a5fb-4047-404b-9787-82a3ae2dd916 req-73e7b9b7-f728-47c8-94e7-07fdac0e98c3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0583963 Sep 03 11:39:25.022490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d8a2a5fb-4047-404b-9787-82a3ae2dd916 req-2ea7642c-488b-4445-acc5-09944b1376b7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343685 Sep 03 11:39:26.160286 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34b5410-3cf3-4adb-97dc-e12cd4da493f req-8c83d839-2904-4c74-9f8b-1f167dc7d1f1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:26.162413 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e34b5410-3cf3-4adb-97dc-e12cd4da493f req-8c83d839-2904-4c74-9f8b-1f167dc7d1f1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0642695 Sep 03 11:39:26.206355 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e34b5410-3cf3-4adb-97dc-e12cd4da493f req-a9a91635-fbfe-4d8d-b5dc-ff32355c2ead tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375566 Sep 03 11:39:26.328215 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e4a44bd6-3093-4ffd-b2c2-62e05c8cdbb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:26.713667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:27.337279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8472dd-5ffe-4d93-8f4e-c0919b8312ec req-a548717a-5ae4-4fda-a16d-be9c76031d18 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:27.338805 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba8472dd-5ffe-4d93-8f4e-c0919b8312ec req-a548717a-5ae4-4fda-a16d-be9c76031d18 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0609875 Sep 03 11:39:27.382625 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba8472dd-5ffe-4d93-8f4e-c0919b8312ec req-f80d2491-e419-4734-9258-0f803da69514 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378356 Sep 03 11:39:27.716360 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:28.511308 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a65f61-a66f-4369-9642-a904e62de6f2 req-7148460c-29a8-4902-9963-b9de5029e3df tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:28.512729 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-16a65f61-a66f-4369-9642-a904e62de6f2 req-7148460c-29a8-4902-9963-b9de5029e3df tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0566561 Sep 03 11:39:28.554020 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-16a65f61-a66f-4369-9642-a904e62de6f2 req-1c2771c8-d827-4b45-a3a9-817e78fb50ef tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345275 Sep 03 11:39:29.087970 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:29.680371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384531a6-6f4a-4d6b-95da-82829457d00f req-8c21be1d-a119-48e3-86d7-7a30d0e30efc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:29.681902 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-384531a6-6f4a-4d6b-95da-82829457d00f req-8c21be1d-a119-48e3-86d7-7a30d0e30efc tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0538259 Sep 03 11:39:29.732870 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-384531a6-6f4a-4d6b-95da-82829457d00f req-9ea6880f-6fcb-42c9-a038-acab352e561f tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418510 Sep 03 11:39:30.849625 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cac86e2-b1a7-4310-99d5-4f819c7e3322 req-46377593-4b4f-43da-9ace-77f814eff7a1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:30.851310 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5cac86e2-b1a7-4310-99d5-4f819c7e3322 req-46377593-4b4f-43da-9ace-77f814eff7a1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0536101 Sep 03 11:39:30.891778 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5cac86e2-b1a7-4310-99d5-4f819c7e3322 req-a1de31f7-5555-453b-95b5-bfb1efe22cb6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336070 Sep 03 11:39:32.016050 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ab9684-5a6b-4e26-83e0-c5a199384117 req-0e760225-1e39-4dab-9843-84cf9a585f2b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:32.023951 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50ab9684-5a6b-4e26-83e0-c5a199384117 req-0e760225-1e39-4dab-9843-84cf9a585f2b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0586779 Sep 03 11:39:32.057609 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-50ab9684-5a6b-4e26-83e0-c5a199384117 req-4a548e51-a55a-4b5f-894d-caedbc2d01ad tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327783 Sep 03 11:39:33.214513 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b292f1c-a6aa-4cb5-a295-94be1aaef07d req-fab68c9d-e29a-46a5-8fa2-d08622c425be tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:33.216269 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3b292f1c-a6aa-4cb5-a295-94be1aaef07d req-fab68c9d-e29a-46a5-8fa2-d08622c425be tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0691032 Sep 03 11:39:33.257686 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3b292f1c-a6aa-4cb5-a295-94be1aaef07d req-f1be7416-ffad-4e5a-9980-e1a0b35166ce tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347848 Sep 03 11:39:34.532693 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d3907c4-588f-4d2f-bba4-4260f4dbb101 req-cb36ce91-f081-4176-89ec-b8c54c1c3b34 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:34.534728 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7d3907c4-588f-4d2f-bba4-4260f4dbb101 req-cb36ce91-f081-4176-89ec-b8c54c1c3b34 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0496881 Sep 03 11:39:34.572014 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7d3907c4-588f-4d2f-bba4-4260f4dbb101 req-006d0900-5870-4b7e-b4ae-b94a2695910a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314050 Sep 03 11:39:35.688904 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67699f2c-48e1-4607-91c2-c6604abe25ae req-e028c8da-6ec8-4128-b680-4992c461eca3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:35.690998 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-67699f2c-48e1-4607-91c2-c6604abe25ae req-e028c8da-6ec8-4128-b680-4992c461eca3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 943 time: 0.0493336 Sep 03 11:39:35.727795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-67699f2c-48e1-4607-91c2-c6604abe25ae req-f27471c0-43cc-4d75-b3c0-faaca7f66333 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309618 Sep 03 11:39:36.277233 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:39:36.372771 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:36.504183 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'port_id': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'mac_address': 'fa:16:3e:e1:5e:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 360, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:39:36.540273 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:36.553302 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:39:36.572541 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:36.666285 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:36.713078 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=9']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:36.849316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6c525d-c85e-4f98-9728-9c101134ad00 req-f5011e64-1e7e-49c7-8425-7d006c5304db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:36.850797 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf6c525d-c85e-4f98-9728-9c101134ad00 req-f5011e64-1e7e-49c7-8425-7d006c5304db tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0540705 Sep 03 11:39:36.880268 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:39:36.888598 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-bf6c525d-c85e-4f98-9728-9c101134ad00 req-7b6004da-1434-4ae3-9b43-a17193a3e1c1 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320373 Sep 03 11:39:38.009703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28aea9b4-428f-475a-ab02-ef17761a6b30 req-35c36a22-9abf-4948-8a85-4d1f045b128d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:38.011230 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28aea9b4-428f-475a-ab02-ef17761a6b30 req-35c36a22-9abf-4948-8a85-4d1f045b128d tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 944 time: 0.0500438 Sep 03 11:39:38.050169 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-28aea9b4-428f-475a-ab02-ef17761a6b30 req-c3d1f0d1-9a76-4e88-b319-e573bf3f94a4 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328898 Sep 03 11:39:38.320233 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:39:38.345404 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:38.345851 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.428784 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.453517 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:39:38.456185 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b0686dc-5606-4c33-9dee-33d67492322e" -d '{"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:39:38.469357 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:38.498327 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:39:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1649a724-c075-4d77-8446-eb2e99f7a186 x-openstack-request-id: req-1649a724-c075-4d77-8446-eb2e99f7a186 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:39:38.498694 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-plugged", "status": "completed", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:39:38.498977 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-1649a724-c075-4d77-8446-eb2e99f7a186 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:39:38.499425 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'code': 200} Sep 03 11:39:38.609032 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40450) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:38.735253 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.770663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Deleting port 57964a84-930f-4f57-ab2d-9ac103b74ed0 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:38.771100 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.792422 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=10']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:38.848941 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.849265 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:38.863110 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Calling delete_port for 57964a84-930f-4f57-ab2d-9ac103b74ed0 owned by network:floatingip {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:38.958029 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d50b8f6-031d-4f0f-89b2-7274f973cf74 req-9f74c2f4-10f9-48d2-bb8f-1c5744644d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:38.959579 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9d50b8f6-031d-4f0f-89b2-7274f973cf74 req-9f74c2f4-10f9-48d2-bb8f-1c5744644d26 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1099 time: 0.0416694 Sep 03 11:39:39.000502 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9d50b8f6-031d-4f0f-89b2-7274f973cf74 req-88ca11b0-0772-48ec-9ee7-a76c5cf14470 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337641 Sep 03 11:39:39.129876 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:39.155843 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event deleted for resources: {'Port': ['ID=57964a84-930f-4f57-ab2d-9ac103b74ed0,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:39.168760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.169101 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.169440 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.169772 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.170100 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.170447 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.170774 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.171097 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.171420 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.171739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.172163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.172428 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:39.178690 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f06ee71-d813-4ff3-ba57-6e7b6d380d99 req-8b3e7c2e-b1b5-4842-99f1-0f53bdd48d21 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:39.182825 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3f06ee71-d813-4ff3-ba57-6e7b6d380d99 req-8b3e7c2e-b1b5-4842-99f1-0f53bdd48d21 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.0621064 Sep 03 11:39:39.221901 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3f06ee71-d813-4ff3-ba57-6e7b6d380d99 req-0395bbe1-ab58-4995-b3a4-728878e04ad6 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353191 Sep 03 11:39:39.231740 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for floatingip, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:39.232071 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Floating IP 58874a23-6899-40ab-a4f4-2953efd341dd disassociated (deleted). External IP: 172.27.0.111, port: f6f00829-c3b2-4786-8501-3542b436780c. Sep 03 11:39:39.433378 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Router 5de10b45-f5e8-4001-950d-d88a63808984 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:39:39.537907 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:39:39.542743 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:39.547739 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Sync routers for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:39:39.557416 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:39.558014 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:39.570939 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-2d03ad3b-3360-42dc-8378-9a2e38935992 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "DELETE /v2.0/floatingips/58874a23-6899-40ab-a4f4-2953efd341dd HTTP/1.1" status: 204 len: 168 time: 0.9609182 Sep 03 11:39:39.571559 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:39:39.573826 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9594a186-5512-421d-91d7-cb1a2ea074cb" -d '{"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:39:39.611595 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:39:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ef6a1e6-a532-4e96-a5d1-d6a8900a4ab6 x-openstack-request-id: req-1ef6a1e6-a532-4e96-a5d1-d6a8900a4ab6 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:39:39.612209 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:39:39.612209 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-1ef6a1e6-a532-4e96-a5d1-d6a8900a4ab6 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:39:39.612607 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'status': 'completed', 'code': 200} Sep 03 11:39:39.664695 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:39.678081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-81a3f239-9abe-4843-88b5-5675a55c91b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:39.679657 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-81a3f239-9abe-4843-88b5-5675a55c91b8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f29a932166fe443d8e6a5014f9de527d&device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 1099 time: 0.0425506 Sep 03 11:39:39.780358 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-907a00bc-42ea-42b4-9715-68d1a6508df5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:39.781799 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-907a00bc-42ea-42b4-9715-68d1a6508df5 service neutron] 10.222.0.11 "GET /v2.0/networks?id=a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 200 len: 909 time: 0.0951202 Sep 03 11:39:39.827876 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-65eaea75-8ca6-45c5-a1dc-da2e81cc1d3f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 200 len: 217 time: 0.0352044 Sep 03 11:39:39.865808 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:39.886188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-c21fdfa5-6ffd-4cce-ac77-4b131789f9b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:39.887735 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-c21fdfa5-6ffd-4cce-ac77-4b131789f9b1 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 200 len: 847 time: 0.0444474 Sep 03 11:39:39.896591 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Checking router: 5de10b45-f5e8-4001-950d-d88a63808984 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:39:39.905272 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:39.905880 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:39.939897 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-461a2b16-3474-4394-944a-811ac9cea796 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:39.943239 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-461a2b16-3474-4394-944a-811ac9cea796 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=a673d589-6e7c-4ca2-8a0c-89d350ececf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0430496 Sep 03 11:39:40.022822 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:40.063671 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95c88cf-c549-4918-8ab9-e2a54aafba70 req-7416a293-9bcd-4bb0-95b5-14c00571280f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:40.065820 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c95c88cf-c549-4918-8ab9-e2a54aafba70 req-7416a293-9bcd-4bb0-95b5-14c00571280f tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.1055460 Sep 03 11:39:40.119749 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-d7aac3b3-73cc-415d-b702-4db30cb2554a service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672256 Sep 03 11:39:40.127513 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c95c88cf-c549-4918-8ab9-e2a54aafba70 req-eeceb952-a7da-4489-82d0-fafcefb029ca tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519440 Sep 03 11:39:40.223976 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9594a186-5512-421d-91d7-cb1a2ea074cb req-f0c88328-4b56-41bc-bc5b-b95e699d1c49 service neutron] 10.222.0.11 "GET /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0942960 Sep 03 11:39:40.247367 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:40.273738 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328f2da5-efde-41d7-9687-5b0b4c40c317 None None] The sync data for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi is: [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:34:57Z', 'revision_number': 4, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '57dc65d4-44cf-4aa9-a7f9-04075564886f', 'name': '', 'network_id': 'a673d589-6e7c-4ca2-8a0c-89d350ececf8', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'mac_address': 'fa:16:3e:70:f5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_interface', 'standard_attr_id': 503, 'fixed_ips': [{'subnet_id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:57Z', 'updated_at': '2021-09-03T11:35:04Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'subnets': [{'id': '610178de-2f3b-4c7b-a5c7-46ef7f74ed76', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:39:40.352753 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5800152a-f928-4bda-9cbb-e00022c74cf3 req-42b740e8-dce6-4640-ba60-975c1bae2f21 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:40.354288 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5800152a-f928-4bda-9cbb-e00022c74cf3 req-42b740e8-dce6-4640-ba60-975c1bae2f21 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.0546808 Sep 03 11:39:40.394019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5800152a-f928-4bda-9cbb-e00022c74cf3 req-4d35f50b-32a7-4e97-bf34-18b24e557a6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335426 Sep 03 11:39:40.510357 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6afbe7c2-9ffe-4c1e-a8ec-176fb42d51a7 None None] New status for floating IP 58874a23-6899-40ab-a4f4-2953efd341dd: DOWN {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:39:41.257410 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38ffee9-df7b-4fd2-aa59-3365c782bd0e req-964fe647-30be-4953-a988-49b6f0d8c602 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:41.259012 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c38ffee9-df7b-4fd2-aa59-3365c782bd0e req-964fe647-30be-4953-a988-49b6f0d8c602 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0534267 Sep 03 11:39:41.300102 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-c38ffee9-df7b-4fd2-aa59-3365c782bd0e req-93a3f18c-6a43-4a93-9e62-4be91fc704e9 tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/security-groups?id=0e7519ce-2af0-4317-9c10-6924af52ed89&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349016 Sep 03 11:39:41.518925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d4729a-e74d-4d2d-a7c3-b6643ab09100 req-b550aed3-daf9-481f-a4a0-500c4731371a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:41.520367 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-01d4729a-e74d-4d2d-a7c3-b6643ab09100 req-b550aed3-daf9-481f-a4a0-500c4731371a tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.0499451 Sep 03 11:39:41.557697 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-01d4729a-e74d-4d2d-a7c3-b6643ab09100 req-15937edd-096d-45c2-a660-21c4213da08c tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313771 Sep 03 11:39:41.645234 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae9abb74-f497-4db5-b222-11414662ac85 req-14bfc6ad-281c-4c76-9514-e6f36f01549c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:41.646673 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ae9abb74-f497-4db5-b222-11414662ac85 req-14bfc6ad-281c-4c76-9514-e6f36f01549c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.11 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 946 time: 0.0468667 Sep 03 11:39:41.737013 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Deleting port f6f00829-c3b2-4786-8501-3542b436780c {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:41.737348 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:41.822755 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] For port f6f00829-c3b2-4786-8501-3542b436780c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=f6f00829-c3b2-4786-8501-3542b436780c,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:41.823033 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:41.835905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Calling delete_port for f6f00829-c3b2-4786-8501-3542b436780c owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:42.013261 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:42.042145 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event deleted for resources: {'Port': ['ID=f6f00829-c3b2-4786-8501-3542b436780c,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:42.072430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.072824 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.073112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.073442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.073768 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.074095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.074438 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.074758 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.075080 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.075405 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.075727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.076152 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:42.094928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] No DVR routers for this DVR port f6f00829-c3b2-4786-8501-3542b436780c on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:39:42.097953 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:42.100019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ae9abb74-f497-4db5-b222-11414662ac85 req-0e9aaf30-d56b-41e9-95ba-945de2a2b26c tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.11 "DELETE /v2.0/ports/f6f00829-c3b2-4786-8501-3542b436780c HTTP/1.1" status: 204 len: 173 time: 0.4471135 Sep 03 11:39:42.100447 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-deleted', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:39:42.102686 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c93f03b5-0407-44f5-ad4b-716de3023f96" -d '{"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-deleted", "tag": "f6f00829-c3b2-4786-8501-3542b436780c"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:39:42.138667 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:39:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd982592-f0e0-45ac-8fdc-db0991e9bafa x-openstack-request-id: req-bd982592-f0e0-45ac-8fdc-db0991e9bafa {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:39:42.138960 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "829a3752-edd7-40cd-a072-7a508aacc20b", "name": "network-vif-deleted", "tag": "f6f00829-c3b2-4786-8501-3542b436780c", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:39:42.139215 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-bd982592-f0e0-45ac-8fdc-db0991e9bafa {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:39:42.139647 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '829a3752-edd7-40cd-a072-7a508aacc20b', 'name': 'network-vif-deleted', 'tag': 'f6f00829-c3b2-4786-8501-3542b436780c', 'status': 'completed', 'code': 200} Sep 03 11:39:42.411014 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9cea2ca4-0d79-451d-ad5c-88bd90b406a0 req-2292b805-9ec5-4494-8b2c-f1096e0449bf tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 210 time: 0.0355771 Sep 03 11:39:43.511233 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-77b813b9-f061-4f64-8a0e-938440bb26ff req-f65e10c9-94f1-46ba-bb1b-4419f5d38c0b tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "GET /v2.0/ports?device_id=829a3752-edd7-40cd-a072-7a508aacc20b HTTP/1.1" status: 200 len: 210 time: 0.0257599 Sep 03 11:39:43.775137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:43.944155 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:39:44.358594 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:44.380529 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: f6f00829-c3b2-4786-8501-3542b436780c {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:44.380870 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device f6f00829-c3b2-4786-8501-3542b436780c not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:44.567249 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40510) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:44.624725 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:44.649309 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:44.781012 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:44.783770 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:44.784921 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] 10.222.0.16 "DELETE /v2.0/security-groups/0e7519ce-2af0-4317-9c10-6924af52ed89 HTTP/1.1" status: 204 len: 168 time: 0.2167032 Sep 03 11:39:44.794218 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e18bdc-6b54-4d9f-8585-ae0e25eac1da tempest-TestShelveInstance-1425737127 tempest-TestShelveInstance-1425737127-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e7519ce-2af0-4317-9c10-6924af52ed89,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:44.858516 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40514) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:45.197429 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:45.435282 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Deleting port 57dc65d4-44cf-4aa9-a7f9-04075564886f {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:45.435861 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:45.513985 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] For port 57dc65d4-44cf-4aa9-a7f9-04075564886f, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=57dc65d4-44cf-4aa9-a7f9-04075564886f,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:45.514262 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:45.526523 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Calling delete_port for 57dc65d4-44cf-4aa9-a7f9-04075564886f owned by network:router_interface {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:45.784425 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:45.813079 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Pushing event deleted for resources: {'Port': ['ID=57dc65d4-44cf-4aa9-a7f9-04075564886f,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:45.978632 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:46.420609 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Router 5de10b45-f5e8-4001-950d-d88a63808984 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:39:46.528865 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:39:46.534219 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e93182af-10fc-4773-b1b6-74d2a1529f87 admin admin] 10.222.0.16 "PUT /v2.0/routers/5de10b45-f5e8-4001-950d-d88a63808984/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6746438 Sep 03 11:39:46.536799 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40516) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:46.539550 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Sync routers for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:39:46.549093 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:46.549688 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:46.639023 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:46.739010 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:46.739529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:46.888165 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Deleting port df7e3022-1070-4742-bd7a-23d9b4349284 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:46.888828 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:46.912144 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20'}], 'enable_snat': True}, 'gw_port_id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:39:45Z', 'revision_number': 5, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port': {'id': 'df7e3022-1070-4742-bd7a-23d9b4349284', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:a0:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de10b45-f5e8-4001-950d-d88a63808984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 502, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.20', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:55Z', 'updated_at': '2021-09-03T11:35:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:46.937014 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Checking router: 5de10b45-f5e8-4001-950d-d88a63808984 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:39:46.945610 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Routers {'5de10b45-f5e8-4001-950d-d88a63808984'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:46.946206 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['5de10b45-f5e8-4001-950d-d88a63808984'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:46.968607 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] For port df7e3022-1070-4742-bd7a-23d9b4349284, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=df7e3022-1070-4742-bd7a-23d9b4349284,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:46.968974 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:46.981376 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Calling delete_port for df7e3022-1070-4742-bd7a-23d9b4349284 owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:47.037411 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] Set router 5de10b45-f5e8-4001-950d-d88a63808984 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:47.092882 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:39:46Z', 'revision_number': 6, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:47.119527 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b275b933-e4c0-46dd-bb05-ea9bf0d13233 None None] The sync data for ids ['5de10b45-f5e8-4001-950d-d88a63808984'] in dv-cinder-760199-12-iscsi is: [{'id': '5de10b45-f5e8-4001-950d-d88a63808984', 'name': 'tempest-TestShelveInstance-924198080-router', 'tenant_id': 'f29a932166fe443d8e6a5014f9de527d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:54Z', 'updated_at': '2021-09-03T11:39:46Z', 'revision_number': 6, 'project_id': 'f29a932166fe443d8e6a5014f9de527d', 'gw_port_host': None}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:39:47.209555 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.236315 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Pushing event deleted for resources: {'Port': ['ID=df7e3022-1070-4742-bd7a-23d9b4349284,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:47.298779 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.386120 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.388234 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.512573 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.517812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5de10b45-f5e8-4001-950d-d88a63808984 {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:39:47.517812 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.518747 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1d7fa268-a90d-4aab-8d4a-da8756feff90 admin admin] 10.222.0.16 "DELETE /v2.0/routers/5de10b45-f5e8-4001-950d-d88a63808984 HTTP/1.1" status: 204 len: 168 time: 0.9809070 Sep 03 11:39:47.521364 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40518) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:47.571189 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Deleting subnet 610178de-2f3b-4c7b-a5c7-46ef7f74ed76 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:39:47.574207 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.609915 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.683991 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.801618 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.825221 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=610178de-2f3b-4c7b-a5c7-46ef7f74ed76,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:47.831979 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.834418 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-83bb81f8-69dd-4a82-8c3d-0dd7b66fb6d5 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/610178de-2f3b-4c7b-a5c7-46ef7f74ed76 HTTP/1.1" status: 204 len: 168 time: 0.3118985 Sep 03 11:39:47.836894 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40520) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:47.838494 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c10f8d30-44b7-465a-9cd9-cc427226abd1 None None] Network a673d589-6e7c-4ca2-8a0c-89d350ececf8 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:39:47.909899 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:47.964677 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Deleting port 902833bb-f173-4fce-bd8b-4a4ad7305ffd {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:47.965015 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.031340 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] For port 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=902833bb-f173-4fce-bd8b-4a4ad7305ffd,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:48.031924 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.037254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] DHCP port deletion for a673d589-6e7c-4ca2-8a0c-89d350ececf8 request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:39:48.046922 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Calling delete_port for 902833bb-f173-4fce-bd8b-4a4ad7305ffd owned by network:dhcp {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:48.085771 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Deleting port 902833bb-f173-4fce-bd8b-4a4ad7305ffd {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:48.086233 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.153463 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] For port 902833bb-f173-4fce-bd8b-4a4ad7305ffd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=902833bb-f173-4fce-bd8b-4a4ad7305ffd,segment=NetworkSegment(b65e6ba6-095f-4de7-a881-ad7c6d65ef16),segment_id=b65e6ba6-095f-4de7-a881-ad7c6d65ef16)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:48.153854 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.165937 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Calling delete_port for 902833bb-f173-4fce-bd8b-4a4ad7305ffd owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:48.209642 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.236528 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Pushing event deleted for resources: {'Port': ['ID=902833bb-f173-4fce-bd8b-4a4ad7305ffd,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:48.244225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.244345 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] No DVR routers for this DVR port 902833bb-f173-4fce-bd8b-4a4ad7305ffd on host dv-cinder-760199-12-iscsi {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:39:48.265071 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] Pushing event deleted for resources: {'Port': ['ID=902833bb-f173-4fce-bd8b-4a4ad7305ffd,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:48.272045 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb7bc271-b714-49b8-bfd6-25a1fc9b7e4d None None] No DVR routers for this DVR port 902833bb-f173-4fce-bd8b-4a4ad7305ffd on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:39:48.319718 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.329535 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a673d589-6e7c-4ca2-8a0c-89d350ececf8']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:48.339496 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:48.339787 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b65e6ba6-095f-4de7-a881-ad7c6d65ef16') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:48.348490 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.361983 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.367674 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Releasing vlan 397 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:39:48.368054 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:39:48.369651 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:39:48.472370 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.477693 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:48.479584 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] 10.222.0.16 "DELETE /v2.0/networks/a673d589-6e7c-4ca2-8a0c-89d350ececf8 HTTP/1.1" status: 204 len: 168 time: 0.6416869 Sep 03 11:39:48.482692 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40522) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:48.491328 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc8613a-5cb9-4aab-97fb-30e511ee3629 admin admin] Pushing event deleted for resources: {'Network': ['ID=a673d589-6e7c-4ca2-8a0c-89d350ececf8,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:48.826083 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.063653 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Deleting port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:49.063889 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.068463 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device df7e3022-1070-4742-bd7a-23d9b4349284 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:49.088883 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: df7e3022-1070-4742-bd7a-23d9b4349284 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:49.089147 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device df7e3022-1070-4742-bd7a-23d9b4349284 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:49.089556 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 57dc65d4-44cf-4aa9-a7f9-04075564886f no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:49.112103 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 57dc65d4-44cf-4aa9-a7f9-04075564886f {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:49.112429 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 57dc65d4-44cf-4aa9-a7f9-04075564886f not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:49.112839 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 902833bb-f173-4fce-bd8b-4a4ad7305ffd no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:49.131437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 902833bb-f173-4fce-bd8b-4a4ad7305ffd {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:49.131784 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 902833bb-f173-4fce-bd8b-4a4ad7305ffd not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:49.143948 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] For port 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:49.144319 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.156673 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Calling delete_port for 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af owned by network:router_interface {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:49.375101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.397723 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Pushing event deleted for resources: {'Port': ['ID=0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:49.568359 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.773913 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Router 87b7295f-d3a9-435f-af59-d880c0855fe2 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:39:49.874802 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:39:49.881085 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3a35f317-8af1-4324-9a6b-48b00e3ad421 admin admin] 10.222.0.16 "PUT /v2.0/routers/87b7295f-d3a9-435f-af59-d880c0855fe2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.3972185 Sep 03 11:39:49.882540 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40524) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:49.883618 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Sync routers for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:39:49.893911 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:49.894567 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:49.986184 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:49.999333 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:50.087818 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.177054 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:39:49Z', 'revision_number': 5, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port': {'id': 'e8de3f44-9db6-4753-bbbc-b4ca918acd64', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b0:03:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:35:01Z', 'updated_at': '2021-09-03T11:35:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:50.206958 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Checking router: 87b7295f-d3a9-435f-af59-d880c0855fe2 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:39:50.215004 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Deleting port e8de3f44-9db6-4753-bbbc-b4ca918acd64 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:50.215228 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Routers {'87b7295f-d3a9-435f-af59-d880c0855fe2'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:50.215337 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.215836 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['87b7295f-d3a9-435f-af59-d880c0855fe2'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:50.296163 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] For port e8de3f44-9db6-4753-bbbc-b4ca918acd64, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e8de3f44-9db6-4753-bbbc-b4ca918acd64,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:50.296526 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.297645 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] Set router 87b7295f-d3a9-435f-af59-d880c0855fe2 gateway port host: None {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:50.308926 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Calling delete_port for e8de3f44-9db6-4753-bbbc-b4ca918acd64 owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:50.352287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:39:50Z', 'revision_number': 6, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:50.377600 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f618400e-8fe8-4168-82ac-8d5481c31b8d None None] The sync data for ids ['87b7295f-d3a9-435f-af59-d880c0855fe2'] in dv-cinder-760199-12-iscsi is: [{'id': '87b7295f-d3a9-435f-af59-d880c0855fe2', 'name': 'tempest-TestShelveInstance-2028482626-router', 'tenant_id': 'a2b5661993e2477a82653f40eb1c137c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:35:00Z', 'updated_at': '2021-09-03T11:39:50Z', 'revision_number': 6, 'project_id': 'a2b5661993e2477a82653f40eb1c137c', 'gw_port_host': None}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:39:50.534853 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.559962 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Pushing event deleted for resources: {'Port': ['ID=e8de3f44-9db6-4753-bbbc-b4ca918acd64,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:50.622776 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.716014 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.718179 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.832468 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.833034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 87b7295f-d3a9-435f-af59-d880c0855fe2 {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:39:50.838337 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.841193 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-e2b641f6-b8bc-4e6f-9b7a-1dbabe098a9d admin admin] 10.222.0.16 "DELETE /v2.0/routers/87b7295f-d3a9-435f-af59-d880c0855fe2 HTTP/1.1" status: 204 len: 168 time: 0.9559679 Sep 03 11:39:50.842161 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40526) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:50.886561 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Deleting subnet e532f019-f402-40c4-9ca4-47c4bdbcdd5c {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:39:50.889580 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:50.926827 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.029975 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.143482 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:51.162071 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.167905 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:51.168252 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 0bb42a4e-2f30-4917-a4d8-d69cd5e1b1af not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:51.168665 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e8de3f44-9db6-4753-bbbc-b4ca918acd64 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:51.187418 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: e8de3f44-9db6-4753-bbbc-b4ca918acd64 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:51.188073 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e8de3f44-9db6-4753-bbbc-b4ca918acd64 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:51.192959 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e532f019-f402-40c4-9ca4-47c4bdbcdd5c,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:51.201865 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.206656 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1c2f6767-84c8-4a4e-a407-fbbfdb15a009 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/e532f019-f402-40c4-9ca4-47c4bdbcdd5c HTTP/1.1" status: 204 len: 168 time: 0.3605134 Sep 03 11:39:51.207008 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40528) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:51.214061 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0b3530e-01ec-45f4-8de3-296b7f4adf9f None None] Network 42595304-bece-4cdb-988d-e92d7edf5d52 requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:39:51.405066 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] DHCP port deletion for 42595304-bece-4cdb-988d-e92d7edf5d52 request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:39:51.461388 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Deleting port 3ff63202-7097-40a2-8f09-6c5fc1df8183 {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:51.461872 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.536824 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] For port 3ff63202-7097-40a2-8f09-6c5fc1df8183, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=3ff63202-7097-40a2-8f09-6c5fc1df8183,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:51.537220 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.543498 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.550483 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Calling delete_port for 3ff63202-7097-40a2-8f09-6c5fc1df8183 owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:51.594853 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Deleting port 3ff63202-7097-40a2-8f09-6c5fc1df8183 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:39:51.595185 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.658041 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] For port 3ff63202-7097-40a2-8f09-6c5fc1df8183, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=3ff63202-7097-40a2-8f09-6c5fc1df8183,segment=NetworkSegment(1be7b8ca-935c-4fea-864b-4a5cc8c5ad68),segment_id=1be7b8ca-935c-4fea-864b-4a5cc8c5ad68)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:51.658296 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.669422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Calling delete_port for 3ff63202-7097-40a2-8f09-6c5fc1df8183 owned by network:dhcp {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:39:51.705240 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.730640 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] Pushing event deleted for resources: {'Port': ['ID=3ff63202-7097-40a2-8f09-6c5fc1df8183,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:51.734321 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6de262af-6da4-493a-aa4b-e1f4a120b69c None None] No DVR routers for this DVR port 3ff63202-7097-40a2-8f09-6c5fc1df8183 on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:39:51.748678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.774430 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Pushing event deleted for resources: {'Port': ['ID=3ff63202-7097-40a2-8f09-6c5fc1df8183,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:51.778777 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] No DVR routers for this DVR port 3ff63202-7097-40a2-8f09-6c5fc1df8183 on host dv-cinder-760199-12-iscsi {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:39:51.849261 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.858944 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['42595304-bece-4cdb-988d-e92d7edf5d52']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:51.869309 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:51.869603 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1be7b8ca-935c-4fea-864b-4a5cc8c5ad68') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:51.879030 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.892096 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.897980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Releasing vlan 355 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:39:51.898360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self.session.flush() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self.session.flush() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self.session.flush() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self.session.flush() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:39:51.900078 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:39:52.018712 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.024012 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.025843 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] 10.222.0.16 "DELETE /v2.0/networks/42595304-bece-4cdb-988d-e92d7edf5d52 HTTP/1.1" status: 204 len: 168 time: 0.8178520 Sep 03 11:39:52.036945 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d86b63-b33c-4f81-a37c-3b3b9af0573b admin admin] Pushing event deleted for resources: {'Network': ['ID=42595304-bece-4cdb-988d-e92d7edf5d52,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:52.398054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40532) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:52.437182 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-4cbd388a-c655-41d4-9f19-e0874e271cc7 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=f29a932166fe443d8e6a5014f9de527d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0379534 Sep 03 11:39:52.440290 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40534) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:52.485396 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.505835 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.620363 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.622886 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:52.624044 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3475655c-ed12-4c95-946d-9ced5ceff2a0 HTTP/1.1" status: 204 len: 168 time: 0.1828721 Sep 03 11:39:52.632143 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf3fce2-b780-4745-800f-5c7c585d1e1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3475655c-ed12-4c95-946d-9ced5ceff2a0,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:53.059322 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 3ff63202-7097-40a2-8f09-6c5fc1df8183 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:39:53.081493 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 3ff63202-7097-40a2-8f09-6c5fc1df8183 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:39:53.081760 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 3ff63202-7097-40a2-8f09-6c5fc1df8183 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:39:53.221590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40540) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:53.263162 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-fc06af09-cc5d-4361-9942-9fdfe250a78d admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=a2b5661993e2477a82653f40eb1c137c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0404129 Sep 03 11:39:53.265553 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40542) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:53.312065 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:53.332925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:53.435577 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:53.438027 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:53.439902 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/1f0355b6-f2a3-4a1b-98f4-2aedf7c76b00 HTTP/1.1" status: 204 len: 168 time: 0.1734545 Sep 03 11:39:53.447507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7498140-cd2e-4c25-b3b9-e82bfa2c7053 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f0355b6-f2a3-4a1b-98f4-2aedf7c76b00,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:53.687167 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2a0927a4-c77e-42ce-86ed-184f32daa881 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.450109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40564) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:54.544371 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1826526440-network', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:39:54.632109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Made reservation on behalf of 278d3bede8a94c32bc0dfdbdfb5259be for: {'network': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:39:54.634414 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.643153 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.729263 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.829766 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.853788 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] vlan segment allocate from pool success with {'vlan_id': 391, 'physical_network': 'physnet1'} {{(pid=94432) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:39:54.863648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99806440-58e0-4541-9b25-8786e383379b,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:54.868268 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:54.868607 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.segments_db [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Added segment fb2f6d21-f66e-4dd1-8720-e92566c40f31 of type vlan for network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f Sep 03 11:39:54.909538 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.018542 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.019529 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:55.020119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.082355 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] Pushing event updated for resources: {'Network': ['ID=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:55.092497 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:39:55.105358 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d9c9c683-ede8-4564-85d6-2bf01f371259 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6541128 Sep 03 11:39:55.109647 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40568) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:55.113073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Request body: {'subnet': {'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1826526440-subnet', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'ip_version': 4}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:39:55.184127 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Made reservation on behalf of 278d3bede8a94c32bc0dfdbdfb5259be for: {'subnet': 1} {{(pid=94432) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:39:55.186789 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-260563317'] for subnet, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.397821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-260546019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-260563291'] for subnet, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.451227 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:55.462209 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94432) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:39:55.462600 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Network hostable DHCP agents. Network: c04d12f4-d98f-4e8c-96f9-c0e3c121f28f, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94432) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:39:55.551788 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94432) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:39:55.608856 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, c04d12f4-d98f-4e8c-96f9-c0e3c121f28f) {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:39:55.613044 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:39:55.613653 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.617498 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4733839-1681-4149-9edd-65970c025cb5 None None] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:39:55.676381 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-00d155ca-26b1-4a1d-b769-63d746b07ea4 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5672240 Sep 03 11:39:55.679209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40570) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:55.683755 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:39:55.760669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:39:55.761501 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.773042 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.774193 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.827023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:55.898936 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Allocated IP 172.20.0.2 (c04d12f4-d98f-4e8c-96f9-c0e3c121f28f/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85/12d32079-0aff-49d8-9ab9-e53cdc208278) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:39:56.018181 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.041646 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.050202 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Transition to ACTIVE for port object 12d32079-0aff-49d8-9ab9-e53cdc208278 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:39:56.064885 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Transition to ACTIVE for port object 12d32079-0aff-49d8-9ab9-e53cdc208278 will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:39:56.118234 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.159581 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:39:56.168903 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:39:56.170781 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Pushing event updated for resources: {'Port': ['ID=12d32079-0aff-49d8-9ab9-e53cdc208278,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:56.172996 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:39:56.230017 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Attempting to bind port 12d32079-0aff-49d8-9ab9-e53cdc208278 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:39:56.230396 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Attempting to bind port 12d32079-0aff-49d8-9ab9-e53cdc208278 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:39:56.230764 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Attempting to bind port 12d32079-0aff-49d8-9ab9-e53cdc208278 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:39:56.235814 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:39:56.236173 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:39:56.236569 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.236955 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Bound using segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:39:56.237416 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Bound port: 12d32079-0aff-49d8-9ab9-e53cdc208278, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:39:56.237784 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.276935 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.295617 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.309676 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] For port 12d32079-0aff-49d8-9ab9-e53cdc208278, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:39:56.313005 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] For port 12d32079-0aff-49d8-9ab9-e53cdc208278, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=12d32079-0aff-49d8-9ab9-e53cdc208278,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:39:56.367231 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-76577d44-045e-48ce-b972-c8fed0a95054 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.396330 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.398365 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Allocated IP 172.27.0.162 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:39:56.456696 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218b7156-6a76-43b7-8bd5-140de9dbf2d0 None None] Pushing event updated for resources: {'Port': ['ID=12d32079-0aff-49d8-9ab9-e53cdc208278,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:56.509735 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.621419 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.671598 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:39:56.673961 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:39:56.675805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Pushing event updated for resources: {'Port': ['ID=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:56.678066 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:39:56.723820 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:56.963767 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.119986 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 12d32079-0aff-49d8-9ab9-e53cdc208278 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:39:57.170334 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.298661 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 12d32079-0aff-49d8-9ab9-e53cdc208278 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:39:57.330200 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-714194df-3a48-4fd3-b289-40f0d2d38849 None None] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:39:57.375057 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94433) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:39:57.474152 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Provisioning for port 12d32079-0aff-49d8-9ab9-e53cdc208278 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:39:57.484123 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:39:57.485297 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Provisioning complete for port 12d32079-0aff-49d8-9ab9-e53cdc208278 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:57.485644 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.494421 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:39:57.504938 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:57.505562 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:57.574660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.575884 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-eb320cd8-aee6-461e-a1e7-8ac21b52fa3a admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.8956199 Sep 03 11:39:57.578625 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40572) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:39:57.580012 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.613650 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:57.628897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] For port 12d32079-0aff-49d8-9ab9-e53cdc208278, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=12d32079-0aff-49d8-9ab9-e53cdc208278,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:57.684496 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.712476 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.770876 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b153b2d6-f3ce-407b-b614-8a5fb57484f6 None None] Pushing event updated for resources: {'Port': ['ID=12d32079-0aff-49d8-9ab9-e53cdc208278,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:57.804196 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:56Z', 'revision_number': 3, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:57.831515 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:39:57.831953 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Updating router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:39:57.835698 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-31ed038d-1c46-4f24-a22c-619be57520c4 None None] Provisioning complete for port 12d32079-0aff-49d8-9ab9-e53cdc208278 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:57.836053 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-31ed038d-1c46-4f24-a22c-619be57520c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:57.858203 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.025228 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.121226 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.130956 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Transition to ACTIVE for port object e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:39:58.179825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Allocated IP 172.20.0.1 (c04d12f4-d98f-4e8c-96f9-c0e3c121f28f/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85/67ccc434-da7d-40a4-b364-63d4ca615862) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:39:58.191964 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.240982 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Attempting to bind port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:39:58.241344 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Attempting to bind port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:39:58.241701 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Attempting to bind port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:39:58.250344 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Pushing event updated for resources: {'Port': ['ID=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:58.254687 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:39:58.255058 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:39:58.255457 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.255850 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:39:58.256327 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Bound port: e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:39:58.256722 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.279521 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.279811 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.280158 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.280489 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.280816 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.281142 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.281465 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.281787 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.282623 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.289750 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.289750 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.289750 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94435) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:39:58.290054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.303696 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Transition to ACTIVE for port object 67ccc434-da7d-40a4-b364-63d4ca615862 will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:39:58.319535 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] For port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:39:58.322507 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] For port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:39:58.384508 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.413240 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.437850 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:39:58.438992 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:58.451260 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:39:58.456272 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:39:58.460484 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:39:58.468146 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Pushing event updated for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:58.508406 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a299a941-f864-4348-92b0-7548de72f10a None None] Pushing event updated for resources: {'Port': ['ID=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:58.510054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.554964 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:39:58.696867 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.721582 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-37dfaaff-255f-44b4-b1f5-b72899911193 None None] Provisioning for port 67ccc434-da7d-40a4-b364-63d4ca615862 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:39:58.725562 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-37dfaaff-255f-44b4-b1f5-b72899911193 None None] Provisioning complete for port 67ccc434-da7d-40a4-b364-63d4ca615862 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:58.725935 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-37dfaaff-255f-44b4-b1f5-b72899911193 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.746840 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:56Z', 'revision_number': 3, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:39:58.761249 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-37dfaaff-255f-44b4-b1f5-b72899911193 None None] Port 67ccc434-da7d-40a4-b364-63d4ca615862 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:39:58.774302 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2272b4a0-11d8-4070-aa9b-141d8d9c5c6b None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:56Z', 'revision_number': 3, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:39:58.870550 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:58.940853 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.023774 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.027577 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Pushing event updated for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:59.090093 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.145316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:39:59.147846 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:39:59.178684 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:39:59.290892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:39:59.295195 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:39:59.300588 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:59.301130 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.401296 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.417165 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-08401f5e-f7ec-49f7-9bfc-61c5cd0c6ce4 None None] Provisioning complete for port 67ccc434-da7d-40a4-b364-63d4ca615862 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:59.417544 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-08401f5e-f7ec-49f7-9bfc-61c5cd0c6ce4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.448770 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:39:59.468890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-08401f5e-f7ec-49f7-9bfc-61c5cd0c6ce4 None None] Port 67ccc434-da7d-40a4-b364-63d4ca615862 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:39:59.495754 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.496825 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 12d32079-0aff-49d8-9ab9-e53cdc208278 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:39:59.577501 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:39:59.592221 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 12d32079-0aff-49d8-9ab9-e53cdc208278 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:39:59.592601 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:39:59.695450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:39:59.700281 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-1333f2df-66d4-4334-b7d2-3fcc6c4fca19 admin admin] 10.222.0.16 "PUT /v2.0/routers/ed1cd22b-8bf9-4de7-bd34-b67e13527e9b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1194503 Sep 03 11:40:00.307801 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:00.317648 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:00.318269 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:00.403486 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40588) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:00.409205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-742933716-network', 'tenant_id': '60a05a95d23447fe8439542f0d2906db'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:00.426417 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:00.492895 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Made reservation on behalf of 60a05a95d23447fe8439542f0d2906db for: {'network': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:40:00.495347 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for network, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.504549 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.591054 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.623022 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 2, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:00.642660 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.649355 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:00.649714 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Updating router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b port 67ccc434-da7d-40a4-b364-63d4ca615862 binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:40:00.670047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] vlan segment allocate from pool success with {'vlan_id': 357, 'physical_network': 'physnet1'} {{(pid=94433) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 03 11:40:00.675721 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e03ac02-3cd9-4cab-b9f0-54cc87d235c6,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:00.682313 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.684663 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.684995 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.segments_db [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Added segment 35040c03-8aa0-4bbb-a6ac-0e6940c99fc4 of type vlan for network 9fa17f47-27d5-4019-b98b-7467310223cb Sep 03 11:40:00.726545 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8726710245843'] for network, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.815555 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386'] for network, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.816585 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:00.817170 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:00.877773 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] Pushing event updated for resources: {'Network': ['ID=9fa17f47-27d5-4019-b98b-7467310223cb,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:00.888319 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Network 9fa17f47-27d5-4019-b98b-7467310223cb details requested by agent ovs-agent-dv-cinder-760199-12-iscsi with host dv-cinder-760199-12-iscsi {{(pid=94434) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 03 11:40:00.901166 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-5c4816e5-5c81-423f-a74e-9b9c87802a17 admin admin] 10.222.0.16 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4965253 Sep 03 11:40:00.903803 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40590) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:00.909214 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Request body: {'subnet': {'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-742933716-subnet', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'ip_version': 4}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:00.994628 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.005855 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Transition to ACTIVE for port object 67ccc434-da7d-40a4-b364-63d4ca615862 will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:01.043477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Made reservation on behalf of 60a05a95d23447fe8439542f0d2906db for: {'subnet': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:40:01.048577 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3234400'] for subnet, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.077170 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:01.133846 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:01.134131 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.136757 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.229745 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab3bdea-d821-43f3-b84b-78044c4630ec None None] Pushing event updated for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:01.295282 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2751215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3234382'] for subnet, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.302068 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Attempting to bind port 67ccc434-da7d-40a4-b364-63d4ca615862 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:40:01.305410 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Attempting to bind port 67ccc434-da7d-40a4-b364-63d4ca615862 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:40:01.305410 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Attempting to bind port 67ccc434-da7d-40a4-b364-63d4ca615862 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:01.311155 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:40:01.311821 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:01.311928 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.312305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Bound using segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:40:01.312782 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Bound port: 67ccc434-da7d-40a4-b364-63d4ca615862, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:40:01.313689 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.359041 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6354e2c8-5c5a-4407-8005-31f2c4065b3d,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:01.363526 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Checking segment: {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:01.363879 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Network hostable DHCP agents. Network: 9fa17f47-27d5-4019-b98b-7467310223cb, hostable agents: ['4031b64a-3710-41c2-8127-95ecaa183e3f'], hosted agents: [] {{(pid=94433) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 03 11:40:01.405570 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] For port 67ccc434-da7d-40a4-b364-63d4ca615862, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:40:01.420350 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] For port 67ccc434-da7d-40a4-b364-63d4ca615862, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=67ccc434-da7d-40a4-b364-63d4ca615862,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:40:01.464341 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Network 9fa17f47-27d5-4019-b98b-7467310223cb is scheduled to be hosted by DHCP agent 4031b64a-3710-41c2-8127-95ecaa183e3f with binding_index 1 {{(pid=94433) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 03 11:40:01.493196 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.538752 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-760199-12-iscsi, 9fa17f47-27d5-4019-b98b-7467310223cb) {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:01.543101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:01.543702 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.547565 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:01.548665 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:01.556383 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-092c6905-7542-486d-8115-5cb66a942921 None None] Network 9fa17f47-27d5-4019-b98b-7467310223cb requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:40:01.604692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab3bdea-d821-43f3-b84b-78044c4630ec None None] Pushing event updated for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:01.623720 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a0bbd9c9-bc43-40a0-9146-eede89617316 admin admin] 10.222.0.16 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7149467 Sep 03 11:40:01.623851 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40592) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:01.627654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:01.706456 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-11855'] for router, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.707560 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-757036', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-783548', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-759095', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-11844'] for router, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.733158 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:01.761132 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:01.972530 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.001620 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpf59c4624-c6aa-55e9-a0f3-abbea34d6a20-9fa17f47-27d5-4019-b98b-7467310223cb', 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'fixed_ips': [{'subnet_id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d'}]}} from dv-cinder-760199-12-iscsi. {{(pid=94434) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 03 11:40:02.002475 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.214168 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.db_base_plugin_common [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Allocated IP 172.20.0.2 (9fa17f47-27d5-4019-b98b-7467310223cb/6354e2c8-5c5a-4407-8005-31f2c4065b3d/82d41bf4-6007-4cdc-a525-e20fd70e24fd) {{(pid=94434) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:40:02.245887 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.246261 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:01Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:02.265215 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.282982 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3de8d776-14a2-460a-86dc-b32c40019ea2 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:01Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:02.397168 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Allocated IP 172.27.0.34 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/233c179b-0751-4151-a8dc-dae98a9614f4) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:40:02.429023 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks [] for port, precommit_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.438412 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Transition to ACTIVE for port object 82d41bf4-6007-4cdc-a525-e20fd70e24fd will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:02.457320 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Transition to ACTIVE for port object 82d41bf4-6007-4cdc-a525-e20fd70e24fd will not be triggered until provisioned by entity DHCP. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:02.517344 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.535085 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624'] for port, after_create {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.573032 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Network 9fa17f47-27d5-4019-b98b-7467310223cb is already hosted by enough agents. {{(pid=94434) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:02.575861 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.scheduler.base_scheduler [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Resources bound (agent type, host, resource id): {{(pid=94434) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:02.580216 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Received port after_create {{(pid=94434) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:40:02.588044 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Pushing event updated for resources: {'Port': ['ID=82d41bf4-6007-4cdc-a525-e20fd70e24fd,revision_number=1']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:02.632488 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.647737 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Attempting to bind port 82d41bf4-6007-4cdc-a525-e20fd70e24fd on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:40:02.648164 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Attempting to bind port 82d41bf4-6007-4cdc-a525-e20fd70e24fd by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:40:02.648533 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Attempting to bind port 82d41bf4-6007-4cdc-a525-e20fd70e24fd on network 9fa17f47-27d5-4019-b98b-7467310223cb {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:02.654090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:40:02.654555 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Checking segment: {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:02.654962 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.655358 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Bound using segment: {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:40:02.655835 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Bound port: 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:40:02.656219 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.670661 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:02.672043 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:02.676309 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:40:02.710412 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Pushing event updated for resources: {'Port': ['ID=233c179b-0751-4151-a8dc-dae98a9614f4,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:02.729541 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] For port 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:40:02.732836 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] For port 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=82d41bf4-6007-4cdc-a525-e20fd70e24fd,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:40:02.792713 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:02.860929 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df968aa-6500-423e-838c-f02bd5f5154b None None] Pushing event updated for resources: {'Port': ['ID=82d41bf4-6007-4cdc-a525-e20fd70e24fd,revision_number=2']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:03.175440 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 82d41bf4-6007-4cdc-a525-e20fd70e24fd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:03.284692 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.309883 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 82d41bf4-6007-4cdc-a525-e20fd70e24fd completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:03.315515 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 67ccc434-da7d-40a4-b364-63d4ca615862 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:03.426198 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 67ccc434-da7d-40a4-b364-63d4ca615862 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:03.430826 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 67ccc434-da7d-40a4-b364-63d4ca615862 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:03.431455 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.498020 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-757029', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-783593'] for router, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.517412 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.550893 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 67ccc434-da7d-40a4-b364-63d4ca615862, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=67ccc434-da7d-40a4-b364-63d4ca615862,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:03.603898 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.659041 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:03.682336 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 is scheduled to L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c with binding_index 1 {{(pid=94432) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 03 11:40:03.787071 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5137ab8d-c90c-4a56-bb62-7fd50670ea0d None None] Network 9fa17f47-27d5-4019-b98b-7467310223cb requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:40:03.813766 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:40:03.823478 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Sync routers for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:03.833562 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:03.834168 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:03.941725 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:03.943358 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-febf428b-d619-4c92-a474-db689f88da33 admin admin] 10.222.0.16 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.3197956 Sep 03 11:40:03.946281 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40598) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:04.036721 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:04.037305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Provisioning for port 82d41bf4-6007-4cdc-a525-e20fd70e24fd completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:04.039716 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Provisioning complete for port 82d41bf4-6007-4cdc-a525-e20fd70e24fd triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:04.040186 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.131523 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.180064 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] For port 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=82d41bf4-6007-4cdc-a525-e20fd70e24fd,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:04.238332 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:02Z', 'revision_number': 3, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:04.269649 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Checking router: d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:04.269947 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Updating router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 port 233c179b-0751-4151-a8dc-dae98a9614f4 binding host dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:40:04.295527 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.387415 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.501673 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.546927 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Allocated IP 172.20.0.1 (9fa17f47-27d5-4019-b98b-7467310223cb/6354e2c8-5c5a-4407-8005-31f2c4065b3d/334d1c00-e0fa-457d-97d7-0bce0cd90b7d) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:40:04.548941 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks [] for port, precommit_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.560643 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.provisioning_blocks [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Transition to ACTIVE for port object 233c179b-0751-4151-a8dc-dae98a9614f4 will not be triggered until provisioned by entity L2. {{(pid=94435) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:04.564515 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Pushing event updated for resources: {'Port': ['ID=82d41bf4-6007-4cdc-a525-e20fd70e24fd,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:04.571775 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.572127 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.572468 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.572801 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.573132 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.573576 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.573907 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.574234 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.574581 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.576278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.576278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.576278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ccf084da-206b-4174-9067-1a3accdbdfbb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:04.620115 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-803cbd16-7a9d-49d7-85d5-4c0301b7c517 None None] Provisioning complete for port 82d41bf4-6007-4cdc-a525-e20fd70e24fd triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:04.620485 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-803cbd16-7a9d-49d7-85d5-4c0301b7c517 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.624585 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.664349 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.676155 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Attempting to bind port 233c179b-0751-4151-a8dc-dae98a9614f4 on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:40:04.676695 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Attempting to bind port 233c179b-0751-4151-a8dc-dae98a9614f4 by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:40:04.677044 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Attempting to bind port 233c179b-0751-4151-a8dc-dae98a9614f4 on network e4dc006d-fb22-4cc5-ae28-c350442b2099 {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:04.680739 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Transition to ACTIVE for port object 334d1c00-e0fa-457d-97d7-0bce0cd90b7d will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:04.686605 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee69ab61-91b5-4cd5-898c-d120b54b62b6 None None] Pushing event updated for resources: {'Port': ['ID=233c179b-0751-4151-a8dc-dae98a9614f4,revision_number=2']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:04.689944 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:40:04.690413 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Checking segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94435) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:04.690896 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.691350 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Bound using segment: {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'} {{(pid=94435) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:40:04.691897 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.managers [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Bound port: 233c179b-0751-4151-a8dc-dae98a9614f4, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18788aa0-7c42-4414-898c-7e3c618cd0d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099'}}] {{(pid=94435) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:40:04.692376 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.750063 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] For port 233c179b-0751-4151-a8dc-dae98a9614f4, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94435) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:40:04.753256 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.plugins.ml2.db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] For port 233c179b-0751-4151-a8dc-dae98a9614f4, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=233c179b-0751-4151-a8dc-dae98a9614f4,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94435) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:40:04.787137 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.815585 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron_lib.callbacks.manager [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94435) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.822312 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Network 9fa17f47-27d5-4019-b98b-7467310223cb is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:04.825251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:04.829300 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:40:04.861390 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Pushing event updated for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:04.875434 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-769468'] for router_interface, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:04.882117 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee69ab61-91b5-4cd5-898c-d120b54b62b6 None None] Pushing event updated for resources: {'Port': ['ID=233c179b-0751-4151-a8dc-dae98a9614f4,revision_number=3']} {{(pid=94435) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:04.886013 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:04.886658 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:04.997996 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:05.074675 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.083407 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 82d41bf4-6007-4cdc-a525-e20fd70e24fd up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:05.136655 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d2eae099-b391-4446-a9c8-63bf053801fc None None] Provisioning for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:05.143595 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-d2eae099-b391-4446-a9c8-63bf053801fc None None] Provisioning complete for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:05.145002 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d2eae099-b391-4446-a9c8-63bf053801fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.147049 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 82d41bf4-6007-4cdc-a525-e20fd70e24fd triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:05.147630 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.194809 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:02Z', 'revision_number': 3, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:05.213488 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-d2eae099-b391-4446-a9c8-63bf053801fc None None] Port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:40:05.231064 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10b4e0f0-e07b-466c-afa1-51dde97cb214 None None] The sync data for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi is: [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:02Z', 'revision_number': 3, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:05.255872 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.266898 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 67ccc434-da7d-40a4-b364-63d4ca615862 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:05.315074 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 67ccc434-da7d-40a4-b364-63d4ca615862 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:05.315446 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.317448 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.390645 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Pushing event updated for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:05.394698 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-530364', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-784940'] for router_interface, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.509512 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Network 9fa17f47-27d5-4019-b98b-7467310223cb is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:05.511004 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:05.636474 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:40:05.746549 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-5d01ae90-cd83-4e51-a7e1-ce5a45356bf5 None None] Provisioning complete for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:05.747137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5d01ae90-cd83-4e51-a7e1-ce5a45356bf5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:05.755728 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:40:05.761493 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-92227c55-889c-4f4e-bc8a-4de95a4ec41c admin admin] 10.222.0.16 "PUT /v2.0/routers/d4f05a8c-f0cc-44d3-a23a-b67f4987aa83/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8138022 Sep 03 11:40:05.787761 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-5d01ae90-cd83-4e51-a7e1-ce5a45356bf5 None None] Port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:40:06.311393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40606) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:06.316870 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2099587690', 'description': 'tempest-secgroup-smoke-2099587690 description', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:06.384318 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.477668 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.563534 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.598098 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:06.672332 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.674251 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bdd6409f-5429-4456-9038-64d0b1ab6f37 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3618259 Sep 03 11:40:06.677119 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40608) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:06.681529 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:06.723791 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Sync routers for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:06.732787 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:06.736922 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:06.760801 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.817445 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.839882 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:06.893308 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.915735 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e180abe-d7c0-4b4c-9575-08fc19424f2f,revision_number=0']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:06.981444 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:06.982629 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-7297f782-252f-4628-9c22-6c51c6dd3d7e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3045518 Sep 03 11:40:06.985636 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40610) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:06.990801 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:07.044134 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 4, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '334d1c00-e0fa-457d-97d7-0bce0cd90b7d', 'name': '', 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'mac_address': 'fa:16:3e:d3:56:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_interface', 'standard_attr_id': 619, 'fixed_ips': [{'subnet_id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:04Z', 'updated_at': '2021-09-03T11:40:05Z', 'revision_number': 2, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'subnets': [{'id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:07.070895 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Checking router: d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:07.071247 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Updating router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d binding host dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 03 11:40:07.098745 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.108941 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 233c179b-0751-4151-a8dc-dae98a9614f4 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:07.111743 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.176130 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.254581 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.272158 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db1cf7e0-eade-4410-9f14-dddb95361921,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:07.314748 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 233c179b-0751-4151-a8dc-dae98a9614f4 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:07.322985 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 233c179b-0751-4151-a8dc-dae98a9614f4 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:07.323359 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.340303 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.341534 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ace85938-5e46-4732-af5a-76f139e58720 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3546431 Sep 03 11:40:07.344816 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40612) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:07.350676 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:07.438619 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.497911 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.573029 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.590437 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd7ed4fb-52d1-4cc8-b85b-841415825af0,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:07.600885 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.606291 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks [] for port, precommit_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.627152 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Transition to ACTIVE for port object 334d1c00-e0fa-457d-97d7-0bce0cd90b7d will not be triggered until provisioned by entity L2. {{(pid=94434) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:07.629917 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 233c179b-0751-4151-a8dc-dae98a9614f4, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=233c179b-0751-4151-a8dc-dae98a9614f4,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:07.672073 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.674004 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-5b4d213e-fc7b-4fac-b895-8d7635cf4726 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3279719 Sep 03 11:40:07.676705 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40614) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:07.681287 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:07.699152 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.703536 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.777036 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=233c179b-0751-4151-a8dc-dae98a9614f4,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:07.786762 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.843303 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Attempting to bind port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d on host dv-cinder-760199-12-iscsi for vnic_type normal with profile {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:40:07.843828 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Attempting to bind port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d by drivers openvswitch,hyperv on host dv-cinder-760199-12-iscsi at level 0 using segments [{'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:40:07.844053 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Attempting to bind port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d on network 9fa17f47-27d5-4019-b98b-7467310223cb {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:07.852133 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1313790a-ae6c-44de-bc62-7c5f8d9bf8a6 None None] Pushing event updated for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=3']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:07.857035 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Checking agent: {'id': '20414ff6-7b05-45f9-88ff-4bb9b9d5b492', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-760199-12-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 21, 57), 'started_at': datetime.datetime(2021, 9, 3, 11, 22, 27), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-760199-12-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:40:07.857402 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Checking segment: {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94434) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:07.857803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.858192 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Bound using segment: {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'} {{(pid=94434) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:40:07.858695 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.managers [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Bound port: 334d1c00-e0fa-457d-97d7-0bce0cd90b7d, host: dv-cinder-760199-12-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb'}}] {{(pid=94434) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:40:07.859072 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.862615 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.937769 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] For port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d, host dv-cinder-760199-12-iscsi, cleared binding levels {{(pid=94434) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:40:07.941890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] For port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d, host dv-cinder-760199-12-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94434) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:40:07.948512 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:07.964224 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ddec8690-8fa2-484d-8093-f3fccfbae2d7,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:08.030569 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.066470 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.069844 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-b6a8c952-cdd9-470a-be7d-6d2b3a046a33 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3900242 Sep 03 11:40:08.070422 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40616) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:08.074975 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:08.091279 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:08.097909 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:08.128087 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1313790a-ae6c-44de-bc62-7c5f8d9bf8a6 None None] Pushing event updated for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:08.169712 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Project 278d3bede8a94c32bc0dfdbdfb5259be added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:40:08.175568 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.217797 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:08.252425 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.346472 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.367038 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9b1126fd-7ae1-4c01-878b-e71e3e2909a7,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:08.430550 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-01696169-ee57-4238-b49d-67dc4031164e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 4, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '334d1c00-e0fa-457d-97d7-0bce0cd90b7d', 'name': '', 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'mac_address': 'fa:16:3e:d3:56:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_interface', 'standard_attr_id': 619, 'fixed_ips': [{'subnet_id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:04Z', 'updated_at': '2021-09-03T11:40:07Z', 'revision_number': 4, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'subnets': [{'id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:08.437739 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.442320 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-293ae202-4dc4-46f6-8f3e-d7dfba750dca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3682985 Sep 03 11:40:08.442480 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40618) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:08.446957 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'security_group_rule': {'security_group_id': 'ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb', 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:08.461292 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01696169-ee57-4238-b49d-67dc4031164e None None] The sync data for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi is: [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:40:04Z', 'revision_number': 4, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '334d1c00-e0fa-457d-97d7-0bce0cd90b7d', 'name': '', 'network_id': '9fa17f47-27d5-4019-b98b-7467310223cb', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'mac_address': 'fa:16:3e:d3:56:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_interface', 'standard_attr_id': 619, 'fixed_ips': [{'subnet_id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:04Z', 'updated_at': '2021-09-03T11:40:07Z', 'revision_number': 4, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'subnets': [{'id': '6354e2c8-5c5a-4407-8005-31f2c4065b3d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:08.527059 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.securitygroups_db [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Project 278d3bede8a94c32bc0dfdbdfb5259be added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 03 11:40:08.532460 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.602209 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.675594 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-678096'] for security_group_rule, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.696512 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13c89503-8a77-4cf7-b81d-01f467dcbfd2,revision_number=0']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:08.778509 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:08.779754 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d7e6ccda-1fc3-483a-9726-0ba33506fc6b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3363459 Sep 03 11:40:09.159997 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 334d1c00-e0fa-457d-97d7-0bce0cd90b7d up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:09.321366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:09.325560 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:09.325836 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:09.404219 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:09.444719 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] For port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:09.515766 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:09.516635 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 233c179b-0751-4151-a8dc-dae98a9614f4 up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:09.599225 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Pushing event updated for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:09.611926 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 233c179b-0751-4151-a8dc-dae98a9614f4 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:09.612299 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:11.081667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 334d1c00-e0fa-457d-97d7-0bce0cd90b7d up at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:11.130530 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Provisioning complete for port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:11.130900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:13.597379 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-a38ed6c5-2858-425d-88c6-f498c8fb0b99 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1441674 Sep 03 11:40:13.680877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-6bb876ff-0a6d-4581-ab62-9a61c380168c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:13.682371 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-6bb876ff-0a6d-4581-ab62-9a61c380168c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=306eebd846b1470cbf044b5d93c25528&device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 1099 time: 0.0418117 Sep 03 11:40:13.790679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-9bfab62f-15eb-4945-88fb-49e2c6cc7d0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:13.792039 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-9bfab62f-15eb-4945-88fb-49e2c6cc7d0a service neutron] 10.222.0.11 "GET /v2.0/networks?id=f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 200 len: 918 time: 0.0888402 Sep 03 11:40:13.854685 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:13.860931 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-d041e4bd-6810-4f9c-a9be-9ce9d3394fec service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 200 len: 1001 time: 0.0599344 Sep 03 11:40:13.916129 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-c692b8d5-3b87-43f5-bc67-434cc977c996 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:13.917595 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-c692b8d5-3b87-43f5-bc67-434cc977c996 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 200 len: 856 time: 0.0453856 Sep 03 11:40:13.970578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-84bc9bd9-348a-4f51-b43d-0d0aca5efb7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:13.972421 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-84bc9bd9-348a-4f51-b43d-0d0aca5efb7b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=f307cfd8-e7a3-4489-9872-541459138ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0470855 Sep 03 11:40:13.985661 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-f5b0882a-8ff0-4cd0-bf66-09a48c1411ef service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:40:13.986688 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-f5b0882a-8ff0-4cd0-bf66-09a48c1411ef service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0056489 Sep 03 11:40:14.085048 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-c931ddb7-4dd5-4cae-a134-476f71560109 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906861 Sep 03 11:40:14.186943 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-15c807f5-9182-4ad7-86b4-25f8f980ae0e req-422c892d-b27e-4e0b-baa7-538d194a6272 service neutron] 10.222.0.11 "GET /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895045 Sep 03 11:40:15.571313 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de99da42-d327-4886-a18c-f9abd0e0d1dc req-cafd8abe-1d04-4145-918a-8f6115424ba7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:15.572841 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-de99da42-d327-4886-a18c-f9abd0e0d1dc req-cafd8abe-1d04-4145-918a-8f6115424ba7 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.1063614 Sep 03 11:40:15.612446 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-de99da42-d327-4886-a18c-f9abd0e0d1dc req-a5c756b8-8545-4217-b2d4-e86e8cb09185 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0336585 Sep 03 11:40:16.791816 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373c40d2-7c88-4392-ae5e-03c24dd9629b req-27c27aa2-e53b-439b-b8b5-15a487a67d80 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:16.793305 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-373c40d2-7c88-4392-ae5e-03c24dd9629b req-27c27aa2-e53b-439b-b8b5-15a487a67d80 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.1081138 Sep 03 11:40:16.831872 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-373c40d2-7c88-4392-ae5e-03c24dd9629b req-37552c1a-495a-495e-98ed-d16b2ffe3ff3 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups?id=c031e91b-afe7-4dfa-a769-3db153b555e5&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326059 Sep 03 11:40:16.958657 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-e71d8022-71a9-4166-a482-ace054c985fd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:16.960479 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-e71d8022-71a9-4166-a482-ace054c985fd tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 946 time: 0.0558767 Sep 03 11:40:17.056930 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Deleting port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:17.057264 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.149161 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] For port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:17.149519 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.319110 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.319335 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.319640 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Floating IP f577a179-7912-4343-92d7-668771fe7c89 disassociated. External IP: 172.27.0.172, port: cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c. Sep 03 11:40:17.319984 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Calling delete_port for cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:17.505949 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.535473 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'Port': ['ID=cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:17.656402 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:40:17.768450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:40:17.777884 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:17.788365 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:17.789007 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:17.809468 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] No DVR routers for this DVR port cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:40:17.812316 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:17.814437 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6e36e32f-9147-41d0-ab12-b4f2db74577a req-2f4df01a-5c4a-4a04-8e94-63835a7da1cb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.11 "DELETE /v2.0/ports/cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c HTTP/1.1" status: 204 len: 173 time: 0.8470988 Sep 03 11:40:17.814905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-deleted', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:40:17.817436 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9dbf420-617b-405d-978f-8bfc877b2778" -d '{"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-deleted", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:40:17.854286 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:40:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba534544-75e7-4710-b60a-f3fad82bc1b0 x-openstack-request-id: req-ba534544-75e7-4710-b60a-f3fad82bc1b0 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:40:17.854608 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cc8c6cb-1191-4746-bfec-2c2fb570203a", "name": "network-vif-deleted", "tag": "cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:40:17.854861 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-ba534544-75e7-4710-b60a-f3fad82bc1b0 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:40:17.855257 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cc8c6cb-1191-4746-bfec-2c2fb570203a', 'name': 'network-vif-deleted', 'tag': 'cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c', 'status': 'completed', 'code': 200} Sep 03 11:40:17.901125 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:17.951432 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-87629ce4-c7bd-4d8e-8ac1-5b30dd9eac4c req-04b0ec58-2b1f-4d4e-9bdb-2b6e946b6b72 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/ports?device_id=2cc8c6cb-1191-4746-bfec-2c2fb570203a HTTP/1.1" status: 200 len: 210 time: 0.0337155 Sep 03 11:40:18.142276 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:18.168658 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:18.177972 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:18.178644 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:18.286307 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:18.573155 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:18.600035 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e9e90a4-3437-4d6b-bf37-82aba7117f21 None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:34:32Z', 'revision_number': 4, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '283de847-2846-4c97-b399-25c7ab0a7b2b', 'name': '', 'network_id': 'f307cfd8-e7a3-4489-9872-541459138ccc', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'mac_address': 'fa:16:3e:f5:d6:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_interface', 'standard_attr_id': 483, 'fixed_ips': [{'subnet_id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:31Z', 'updated_at': '2021-09-03T11:34:37Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'subnets': [{'id': '6a03475a-6598-4871-b0ad-65ad1f51a945', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:18.817657 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c206eed3-edd9-4695-8a67-1d002670aca7 None None] New status for floating IP f577a179-7912-4343-92d7-668771fe7c89: DOWN {{(pid=94434) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:40:19.133334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40724) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:19.196451 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.220203 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.326936 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.329435 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.330635 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "DELETE /v2.0/security-groups/c031e91b-afe7-4dfa-a769-3db153b555e5 HTTP/1.1" status: 204 len: 168 time: 0.1962779 Sep 03 11:40:19.334221 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40726) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:19.340599 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b058814-ec0a-4c30-b547-35edc39b4e6b tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c031e91b-afe7-4dfa-a769-3db153b555e5,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:19.350200 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.api.v2.resource [None req-d7f63b21-d140-4cd2-9ca7-21d0ad4d2c77 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] show failed (client error): The resource could not be found. Sep 03 11:40:19.351286 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d7f63b21-d140-4cd2-9ca7-21d0ad4d2c77 tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "GET /v2.0/security-groups/c031e91b-afe7-4dfa-a769-3db153b555e5 HTTP/1.1" status: 404 len: 347 time: 0.0160494 Sep 03 11:40:19.354121 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40728) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:19.477601 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Deleting port d6e239ce-2e5a-44fb-8ea7-01ced217d242 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:19.477865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.555419 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.555742 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.568277 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Calling delete_port for d6e239ce-2e5a-44fb-8ea7-01ced217d242 owned by network:floatingip {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:19.795620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.830139 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Pushing event deleted for resources: {'Port': ['ID=d6e239ce-2e5a-44fb-8ea7-01ced217d242,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:19.889981 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks [] for floatingip, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.892924 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:19.894183 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-16dc8c37-a3fa-405f-aca1-bc05ee1258fb tempest-AttachVolumeShelveTestJSON-2029991616 tempest-AttachVolumeShelveTestJSON-2029991616-project] 10.222.0.16 "DELETE /v2.0/floatingips/f577a179-7912-4343-92d7-668771fe7c89 HTTP/1.1" status: 204 len: 168 time: 0.5390809 Sep 03 11:40:20.475916 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:40:20.495965 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:40:20.496365 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device cc94ae61-9de2-48e7-a4e7-8f6e47db3b5c not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:40:20.943565 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:40:22.622689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40768) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:23.047405 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:23.540341 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Deleting port 283de847-2846-4c97-b399-25c7ab0a7b2b {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:23.540565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:23.621743 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] For port 283de847-2846-4c97-b399-25c7ab0a7b2b, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=283de847-2846-4c97-b399-25c7ab0a7b2b,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:23.622099 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:23.634932 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Calling delete_port for 283de847-2846-4c97-b399-25c7ab0a7b2b owned by network:router_interface {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:23.671900 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-088e490f-bbb7-440d-a49d-ae1c782a220d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:23.888938 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:23.913017 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Pushing event deleted for resources: {'Port': ['ID=283de847-2846-4c97-b399-25c7ab0a7b2b,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:24.081114 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:24.288820 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Router 1daa5492-64d1-4f5a-8048-785e794ae777 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:40:24.389873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:40:24.395040 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2fb2cbc2-6b79-4fbb-9258-b691f4f47bff admin admin] 10.222.0.16 "PUT /v2.0/routers/1daa5492-64d1-4f5a-8048-785e794ae777/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7711468 Sep 03 11:40:24.397926 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40776) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:24.400574 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Sync routers for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:24.409922 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:24.410560 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:24.498148 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks [] for router, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:24.510403 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:24.597553 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:24.683621 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:40:23Z', 'revision_number': 5, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port': {'id': 'ba14d297-7b54-41cc-8378-8d20234f1511', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:ab:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'device_owner': 'network:router_gateway', 'standard_attr_id': 482, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:34:28Z', 'updated_at': '2021-09-03T11:34:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:24.692951 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Deleting port ba14d297-7b54-41cc-8378-8d20234f1511 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:24.693478 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:24.713237 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Checking router: 1daa5492-64d1-4f5a-8048-785e794ae777 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:24.721362 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Routers {'1daa5492-64d1-4f5a-8048-785e794ae777'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:24.721984 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:39:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['1daa5492-64d1-4f5a-8048-785e794ae777'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:24.774677 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] For port ba14d297-7b54-41cc-8378-8d20234f1511, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=ba14d297-7b54-41cc-8378-8d20234f1511,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:24.774925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:24.787270 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Calling delete_port for ba14d297-7b54-41cc-8378-8d20234f1511 owned by network:router_gateway {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:24.807312 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] Set router 1daa5492-64d1-4f5a-8048-785e794ae777 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:24.856937 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:40:24Z', 'revision_number': 6, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:24.887424 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-daa456d5-56d1-4f35-b8ac-79753333ab0a None None] The sync data for ids ['1daa5492-64d1-4f5a-8048-785e794ae777'] in dv-cinder-760199-12-iscsi is: [{'id': '1daa5492-64d1-4f5a-8048-785e794ae777', 'name': 'tempest-AttachVolumeShelveTestJSON-1442563448-router', 'tenant_id': '306eebd846b1470cbf044b5d93c25528', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:34:27Z', 'updated_at': '2021-09-03T11:40:24Z', 'revision_number': 6, 'project_id': '306eebd846b1470cbf044b5d93c25528', 'gw_port_host': None}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:25.029925 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.055240 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Pushing event deleted for resources: {'Port': ['ID=ba14d297-7b54-41cc-8378-8d20234f1511,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:25.117124 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.205669 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.208380 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.327707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.328242 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1daa5492-64d1-4f5a-8048-785e794ae777 {{(pid=94433) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:40:25.332670 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.334494 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-42ed13d2-a220-4eac-a182-d88ccfb3b049 admin admin] 10.222.0.16 "DELETE /v2.0/routers/1daa5492-64d1-4f5a-8048-785e794ae777 HTTP/1.1" status: 204 len: 168 time: 0.9350028 Sep 03 11:40:25.337047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40778) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:25.380528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Deleting subnet 6a03475a-6598-4871-b0ad-65ad1f51a945 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:40:25.383530 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.422457 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.499086 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.629987 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.657484 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6a03475a-6598-4871-b0ad-65ad1f51a945,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:25.659507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.661648 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3286c18c-b6b8-46a1-8bdc-f69ff789c880 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/6a03475a-6598-4871-b0ad-65ad1f51a945 HTTP/1.1" status: 204 len: 168 time: 0.3235061 Sep 03 11:40:25.664689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40782) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:25.669686 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c91c6289-8a2f-4fca-bfe3-f5b99f38799f None None] Network f307cfd8-e7a3-4489-9872-541459138ccc requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:40:25.689152 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 283de847-2846-4c97-b399-25c7ab0a7b2b no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:40:25.712245 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 283de847-2846-4c97-b399-25c7ab0a7b2b {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:40:25.712605 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 283de847-2846-4c97-b399-25c7ab0a7b2b not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:40:25.742200 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.797507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Deleting port 5863b223-5387-46f5-81b2-deaa6a9da9a8 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:25.797836 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.869855 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] DHCP port deletion for f307cfd8-e7a3-4489-9872-541459138ccc request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:40:25.870244 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] For port 5863b223-5387-46f5-81b2-deaa6a9da9a8, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5863b223-5387-46f5-81b2-deaa6a9da9a8,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:25.870649 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.882707 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Calling delete_port for 5863b223-5387-46f5-81b2-deaa6a9da9a8 owned by network:dhcp {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:25.917272 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Deleting port 5863b223-5387-46f5-81b2-deaa6a9da9a8 {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:40:25.917642 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.985441 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] For port 5863b223-5387-46f5-81b2-deaa6a9da9a8, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=5863b223-5387-46f5-81b2-deaa6a9da9a8,segment=NetworkSegment(b06e758a-f9ce-4d63-bba0-644a9ca2bd2d),segment_id=b06e758a-f9ce-4d63-bba0-644a9ca2bd2d)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:25.985838 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:25.998100 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Calling delete_port for 5863b223-5387-46f5-81b2-deaa6a9da9a8 owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:40:26.061252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.072400 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.088686 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] No DVR routers for this DVR port 5863b223-5387-46f5-81b2-deaa6a9da9a8 on host dv-cinder-760199-12-iscsi {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:40:26.092040 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=5863b223-5387-46f5-81b2-deaa6a9da9a8,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:26.099105 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] Pushing event deleted for resources: {'Port': ['ID=5863b223-5387-46f5-81b2-deaa6a9da9a8,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:26.101090 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c121a2ae-b649-4cfc-8606-80a4332656c7 None None] No DVR routers for this DVR port 5863b223-5387-46f5-81b2-deaa6a9da9a8 on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:40:26.167160 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.177799 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f307cfd8-e7a3-4489-9872-541459138ccc']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:26.187705 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:26.187999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b06e758a-f9ce-4d63-bba0-644a9ca2bd2d') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:26.196811 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.210655 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.216357 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Releasing vlan 360 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:40:26.216736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:40:26.218348 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:40:26.360842 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a456cfc0-6b33-46e3-985f-458c337f843a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.391281 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.396026 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.398189 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] 10.222.0.16 "DELETE /v2.0/networks/f307cfd8-e7a3-4489-9872-541459138ccc HTTP/1.1" status: 204 len: 168 time: 0.7327652 Sep 03 11:40:26.410310 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da81322-6ac6-4266-a0ef-0a82fa27b8e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=f307cfd8-e7a3-4489-9872-541459138ccc,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:26.662627 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40796) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:26.717393 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-9656e3d7-b48b-43ce-ac9e-73a0eaa5037f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2099587690&fields=id&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 267 time: 0.0561891 Sep 03 11:40:26.727009 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.738171 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-811045d9-c1b0-42f8-a28b-7ee04c2d8c49 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=306eebd846b1470cbf044b5d93c25528&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0744326 Sep 03 11:40:26.742023 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40800) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:26.790638 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.811876 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.830017 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-16c118e0-740b-4e1c-bbb1-48ff7b8cacfe tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:26.831516 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-16c118e0-740b-4e1c-bbb1-48ff7b8cacfe tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.1067390 Sep 03 11:40:26.847941 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-4931aa51-4a24-4ee7-8067-3002d351c0fe tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/quotas/278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 375 time: 0.0092573 Sep 03 11:40:26.902770 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-cc98bd2a-ffae-4818-abd3-408d5f5e16cc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0491359 Sep 03 11:40:26.915329 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.917937 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:26.919133 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/2bd33d76-25f7-40b7-8f22-995bae30401a HTTP/1.1" status: 204 len: 168 time: 0.1772001 Sep 03 11:40:26.929363 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02c4d541-e701-41ae-b885-c1492d71bbf6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bd33d76-25f7-40b7-8f22-995bae30401a,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:27.019697 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-160f9fb5-09d3-4bd9-b332-0bd159c6f771 service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:40:27.021538 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-160f9fb5-09d3-4bd9-b332-0bd159c6f771 service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1064270 Sep 03 11:40:27.085308 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5863b223-5387-46f5-81b2-deaa6a9da9a8 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:40:27.108849 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 5863b223-5387-46f5-81b2-deaa6a9da9a8 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:40:27.109496 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 5863b223-5387-46f5-81b2-deaa6a9da9a8 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:40:27.109906 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device ba14d297-7b54-41cc-8378-8d20234f1511 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:40:27.115825 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-608b8656-4b70-43e9-8bfa-3c956a1ace03 service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846841 Sep 03 11:40:27.129797 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: ba14d297-7b54-41cc-8378-8d20234f1511 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:40:27.130401 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device ba14d297-7b54-41cc-8378-8d20234f1511 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:40:27.215242 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-f038ccd9-bfbc-41bb-9d10-05e68ab536cc service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931327 Sep 03 11:40:27.678150 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:27.793738 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-52de1b20-9395-4fe3-9bbb-0c5460f26557 req-1abda2e4-ef6b-4d87-b97f-75b338d401cc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 210 time: 0.0299680 Sep 03 11:40:28.896327 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-19232491-3d88-44df-8483-4481b249ae57 req-ba0a041f-4cd8-4593-84a5-8b6aea813335 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 210 time: 0.0265720 Sep 03 11:40:29.187366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.003018 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d47d2937-aa2d-4ee3-b87e-e95a97046281 req-d45cd63e-7c32-4999-a04f-73498e4ed89b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 210 time: 0.0370312 Sep 03 11:40:30.022458 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-690b94a0-796a-453a-9600-a8c2a06faf7f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:30.023977 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-690b94a0-796a-453a-9600-a8c2a06faf7f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.1286294 Sep 03 11:40:30.066529 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-876d557b-8202-4a26-b5e9-83b55a965174 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 380 time: 0.0336843 Sep 03 11:40:30.075696 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'port': {'device_id': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'admin_state_up': True, 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'security_groups': ['ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:30.211461 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 40886) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:30.250519 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Made reservation on behalf of 278d3bede8a94c32bc0dfdbdfb5259be for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:40:30.251053 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.332287 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-78e8f380-c0b9-4a91-9acc-773520e1c552 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.416429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.20.0.10 (c04d12f4-d98f-4e8c-96f9-c0e3c121f28f/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85/a12f03dc-a349-4d18-ab3d-892783e7a575) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:40:30.551641 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-78e8f380-c0b9-4a91-9acc-773520e1c552 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.590692 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.603758 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Transition to ACTIVE for port object a12f03dc-a349-4d18-ab3d-892783e7a575 will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:30.658103 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-78e8f380-c0b9-4a91-9acc-773520e1c552 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.694927 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-78e8f380-c0b9-4a91-9acc-773520e1c552 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=ab613a108a9b4951a56774481961d4e6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4823766 Sep 03 11:40:30.696939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e8f380-c0b9-4a91-9acc-773520e1c552 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eae05b53-6ef3-4df6-b087-9e613830f574,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:30.697730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40890) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:30.715596 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.751124 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.759285 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:30.762417 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:30.766210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:40:30.776252 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.800146 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:30.823443 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:30.824198 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.923451 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.933272 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:30.933272 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/eae05b53-6ef3-4df6-b087-9e613830f574 HTTP/1.1" status: 204 len: 168 time: 0.2306790 Sep 03 11:40:30.939242 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74e9aef1-96f1-420e-8fa5-dca35c0b16d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eae05b53-6ef3-4df6-b087-9e613830f574,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:30.960657 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-1b6c5716-4752-43f4-b3aa-20326c73b53e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8880255 Sep 03 11:40:30.978030 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Request body: {'port': {'device_id': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:31.042438 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.043477 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-c20f6ba4-63e3-4949-ad21-e0555afdde86 None None] Provisioning for port a12f03dc-a349-4d18-ab3d-892783e7a575 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:31.043953 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-c20f6ba4-63e3-4949-ad21-e0555afdde86 None None] Provisioning complete for port a12f03dc-a349-4d18-ab3d-892783e7a575 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:31.044333 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-c20f6ba4-63e3-4949-ad21-e0555afdde86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.079691 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-c20f6ba4-63e3-4949-ad21-e0555afdde86 None None] Port a12f03dc-a349-4d18-ab3d-892783e7a575 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:40:31.474195 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e857e5d8-f4e2-446a-a0ba-95f383bfd8e9 req-60b0d18e-5876-48d8-bbfd-e2e328fc1ac5 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:31.475711 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e857e5d8-f4e2-446a-a0ba-95f383bfd8e9 req-60b0d18e-5876-48d8-bbfd-e2e328fc1ac5 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 932 time: 0.3990841 Sep 03 11:40:31.565811 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e857e5d8-f4e2-446a-a0ba-95f383bfd8e9 req-fe8c98bb-ff23-4d0a-8d3e-f3be0db9caca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0822165 Sep 03 11:40:31.568730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40898) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:31.590885 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-973e41b6-6531-41b5-8977-b80bfa40e62a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.660893 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a12f03dc-a349-4d18-ab3d-892783e7a575 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:40:31.668384 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.680777 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Transition to ACTIVE for port object a12f03dc-a349-4d18-ab3d-892783e7a575 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:40:31.687135 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-973e41b6-6531-41b5-8977-b80bfa40e62a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.745345 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.757249 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-973e41b6-6531-41b5-8977-b80bfa40e62a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.791662 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-973e41b6-6531-41b5-8977-b80bfa40e62a admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=0776e064f10f49ba836c1ac97db3af44&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2217793 Sep 03 11:40:31.796636 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40900) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:31.817959 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973e41b6-6531-41b5-8977-b80bfa40e62a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8055996d-fb2f-4551-b365-5bd3786d49cd,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:31.818704 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Pushing event updated for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:31.865075 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.871528 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Attempting to bind port a12f03dc-a349-4d18-ab3d-892783e7a575 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:40:31.871867 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Attempting to bind port a12f03dc-a349-4d18-ab3d-892783e7a575 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:40:31.872231 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Attempting to bind port a12f03dc-a349-4d18-ab3d-892783e7a575 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:31.876952 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Port a12f03dc-a349-4d18-ab3d-892783e7a575 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:40:31.877279 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Attempting to bind port a12f03dc-a349-4d18-ab3d-892783e7a575 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:40:31.883615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 40, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:40:31.883954 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:40:31.884340 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Bound using segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:40:31.884776 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Bound port: a12f03dc-a349-4d18-ab3d-892783e7a575, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:40:31.885134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.889851 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:31.956994 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:40:31.960857 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a12f03dc-a349-4d18-ab3d-892783e7a575,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:40:32.024186 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:32.026776 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:32.027910 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/8055996d-fb2f-4551-b365-5bd3786d49cd HTTP/1.1" status: 204 len: 168 time: 0.2303593 Sep 03 11:40:32.036518 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35198872-27ef-453d-a7f5-6ad67bd80dc0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8055996d-fb2f-4551-b365-5bd3786d49cd,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:32.046493 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:32.080040 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.080858 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:32.082449 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] 10.222.0.11 "PUT /v2.0/ports/a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 200 len: 1094 time: 1.1094103 Sep 03 11:40:32.082962 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:40:32.085360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a63b52df-911d-4923-b24f-86b7b7b0985d" -d '{"events": [{"name": "network-changed", "server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:40:32.124072 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69caaccd-bee9-4295-85c1-c8b7283fc25f service neutron] Pushing event updated for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:32.129811 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:40:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12285866-f2ec-436a-977b-576783f1a092 x-openstack-request-id: req-12285866-f2ec-436a-977b-576783f1a092 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:40:32.130134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:40:32.130397 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-12285866-f2ec-436a-977b-576783f1a092 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:40:32.132345 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'status': 'completed', 'code': 200} Sep 03 11:40:32.193554 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-3f1c9e42-0fbd-45f0-bd09-bd90e4791b1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.195566 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-3f1c9e42-0fbd-45f0-bd09-bd90e4791b1c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1097 time: 0.0446649 Sep 03 11:40:32.300036 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-481a2a87-ad1e-48ae-88f0-ea1acc03ddc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.301635 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-481a2a87-ad1e-48ae-88f0-ea1acc03ddc6 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0983436 Sep 03 11:40:32.396383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-1afb1797-d57e-4399-bf43-b0288140ef76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.397849 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a63b52df-911d-4923-b24f-86b7b7b0985d req-1afb1797-d57e-4399-bf43-b0288140ef76 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0893545 Sep 03 11:40:32.486753 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-9a4f3fc0-972f-4887-ad86-d2b9f25acb60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.488351 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-9a4f3fc0-972f-4887-ad86-d2b9f25acb60 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1097 time: 0.0453379 Sep 03 11:40:32.531329 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-36f16b12-1376-46c6-a0bd-0ade5e454d39 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 200 len: 217 time: 0.0351212 Sep 03 11:40:32.580157 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-2f49a54e-a956-4727-a98f-c540bec04c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.581578 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-2f49a54e-a956-4727-a98f-c540bec04c0b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0437696 Sep 03 11:40:32.631648 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-e902d816-26a9-4a4a-afb4-92f4da19adef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.633048 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-e902d816-26a9-4a4a-afb4-92f4da19adef service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0449488 Sep 03 11:40:32.736598 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4fb236b-87d1-4d6a-b5b9-11f5359b672b req-797b746a-2015-43a1-9045-cccc1b0b7b69 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:32.738083 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d4fb236b-87d1-4d6a-b5b9-11f5359b672b req-797b746a-2015-43a1-9045-cccc1b0b7b69 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.1012819 Sep 03 11:40:32.779292 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-3a72785d-88cd-48f3-85c5-ac42088b68c4 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1341026 Sep 03 11:40:32.811386 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d4fb236b-87d1-4d6a-b5b9-11f5359b672b req-98faa5db-f29d-4aec-8d6a-800daa6914ae tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0665841 Sep 03 11:40:32.876474 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ac8a5611-bde8-4994-b15d-2b833174bbed req-74b8ed3f-0dde-4e8b-9ee1-55c6e774994e service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895867 Sep 03 11:40:33.928825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506dbcf9-cdc4-4836-8643-c08e2488bb6a req-f1966808-e124-4f15-ab3a-425dee4747a9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:33.929406 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-506dbcf9-cdc4-4836-8643-c08e2488bb6a req-f1966808-e124-4f15-ab3a-425dee4747a9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0487561 Sep 03 11:40:33.968555 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-506dbcf9-cdc4-4836-8643-c08e2488bb6a req-a93ccaf1-f955-42ba-b5ec-50495fbdcac4 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0329471 Sep 03 11:40:35.088718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50552fc-921f-4a26-abd0-d62d0084d684 req-21b449e8-f0c2-4648-b04a-50e9aa1ff68a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:35.090229 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d50552fc-921f-4a26-abd0-d62d0084d684 req-21b449e8-f0c2-4648-b04a-50e9aa1ff68a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0527294 Sep 03 11:40:35.127006 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-d50552fc-921f-4a26-abd0-d62d0084d684 req-2b233f87-78f9-4d0b-a0da-6acec34674f6 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307779 Sep 03 11:40:36.240871 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d869635-56b6-405f-9059-654f60db67f4 req-1d306334-4661-4cbf-9257-e7314cbb9369 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:36.242345 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d869635-56b6-405f-9059-654f60db67f4 req-1d306334-4661-4cbf-9257-e7314cbb9369 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0495269 Sep 03 11:40:36.280288 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0d869635-56b6-405f-9059-654f60db67f4 req-4ad95029-c60d-4b9a-ac4e-cc8097bbc8ec tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321362 Sep 03 11:40:37.392435 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38c7b88-904d-4319-a480-15d878237fb1 req-98c26b62-5a56-43db-b041-b66ce77ead45 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:37.393903 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f38c7b88-904d-4319-a480-15d878237fb1 req-98c26b62-5a56-43db-b041-b66ce77ead45 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0484240 Sep 03 11:40:37.431517 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f38c7b88-904d-4319-a480-15d878237fb1 req-a9edfb6b-9c47-4896-b2ab-70c61c9badbc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313275 Sep 03 11:40:38.150419 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 40996) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:38.256526 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffa0f8ac-69d8-4bbd-b3f9-a46de14f676b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.341101 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffa0f8ac-69d8-4bbd-b3f9-a46de14f676b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.446105 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ffa0f8ac-69d8-4bbd-b3f9-a46de14f676b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.484490 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ffa0f8ac-69d8-4bbd-b3f9-a46de14f676b admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=fcd279528b054e25a2b7de73c1b5a051&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3327525 Sep 03 11:40:38.485200 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffa0f8ac-69d8-4bbd-b3f9-a46de14f676b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a5af72d-8600-414d-aa42-d6bf848ed2d0,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:38.487062 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41002) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:38.576471 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcdf7a87-3f2d-4dc0-a922-13e9a721684b req-bfe077ed-5736-48f4-96b6-e74920790aab tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:38.577937 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dcdf7a87-3f2d-4dc0-a922-13e9a721684b req-bfe077ed-5736-48f4-96b6-e74920790aab tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0802951 Sep 03 11:40:38.582521 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.618423 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.650956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-dcdf7a87-3f2d-4dc0-a922-13e9a721684b req-3ccfe8d6-8572-4fce-bbef-74073a072635 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0665176 Sep 03 11:40:38.791388 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.793858 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:38.795377 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/9a5af72d-8600-414d-aa42-d6bf848ed2d0 HTTP/1.1" status: 204 len: 168 time: 0.3042896 Sep 03 11:40:38.804873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b4e482-e701-44aa-811c-532c6cd43aed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a5af72d-8600-414d-aa42-d6bf848ed2d0,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:39.389582 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41008) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:39.403689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bf910055-e6d2-4e7e-aca4-25a07fc76754 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.487626 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bf910055-e6d2-4e7e-aca4-25a07fc76754 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.539782 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-bf910055-e6d2-4e7e-aca4-25a07fc76754 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.581262 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-bf910055-e6d2-4e7e-aca4-25a07fc76754 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=5d166fcb21ef4457b3a5d7adc0a562b9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1905477 Sep 03 11:40:39.582051 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf910055-e6d2-4e7e-aca4-25a07fc76754 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f80fbee-6e80-46cf-afab-bc71d7fdb88d,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:39.584034 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41010) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:39.633834 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.658879 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.763685 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bdf676c-2e07-450d-9764-157a12ae485d req-a33ebdbb-79e2-43e8-9de7-33ef11c194e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:39.765149 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3bdf676c-2e07-450d-9764-157a12ae485d req-a33ebdbb-79e2-43e8-9de7-33ef11c194e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 944 time: 0.0484273 Sep 03 11:40:39.768391 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.771272 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:39.773155 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/5f80fbee-6e80-46cf-afab-bc71d7fdb88d HTTP/1.1" status: 204 len: 168 time: 0.1871829 Sep 03 11:40:39.781485 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f80fbee-6e80-46cf-afab-bc71d7fdb88d,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:39.789609 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.789960 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.790366 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.790851 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.791182 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.791510 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.791838 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.792160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.792593 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.792915 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.793431 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.793759 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75bed15b-3bda-4538-9923-4409f68465ae admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:39.805172 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3bdf676c-2e07-450d-9764-157a12ae485d req-1381c064-3ffd-4cf1-94da-beaa58902c4f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341239 Sep 03 11:40:40.569131 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a12f03dc-a349-4d18-ab3d-892783e7a575 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:40:40.665374 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a12f03dc-a349-4d18-ab3d-892783e7a575,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:40.676232 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'port_id': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'mac_address': 'fa:16:3e:0c:c7:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:40:40.713789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:40.726604 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a12f03dc-a349-4d18-ab3d-892783e7a575 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:40:40.745997 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a12f03dc-a349-4d18-ab3d-892783e7a575,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:40.814266 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:40.870286 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:40.922444 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea42b7f1-fa9e-4393-a10a-6cfea14fc067 req-fc23c48b-dc66-47c4-abbd-1941146620b2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:40.923998 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea42b7f1-fa9e-4393-a10a-6cfea14fc067 req-fc23c48b-dc66-47c4-abbd-1941146620b2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 945 time: 0.0489125 Sep 03 11:40:40.963463 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea42b7f1-fa9e-4393-a10a-6cfea14fc067 req-3864f081-a0a6-4e5c-8547-378f14bb8f08 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327365 Sep 03 11:40:41.024786 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['a12f03dc-a349-4d18-ab3d-892783e7a575'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:40:42.077171 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60adb5bd-af60-47ad-aa0f-31edd1ce89f8 req-fccac559-8173-45fc-9125-7715e143ebf9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:42.078701 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-60adb5bd-af60-47ad-aa0f-31edd1ce89f8 req-fccac559-8173-45fc-9125-7715e143ebf9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 945 time: 0.0493996 Sep 03 11:40:42.124479 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-60adb5bd-af60-47ad-aa0f-31edd1ce89f8 req-8c7530d8-6dba-4aad-bdcd-efb181243881 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389869 Sep 03 11:40:42.577093 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a12f03dc-a349-4d18-ab3d-892783e7a575 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:40:42.686545 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port a12f03dc-a349-4d18-ab3d-892783e7a575 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:40:42.690583 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port a12f03dc-a349-4d18-ab3d-892783e7a575 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:40:42.690957 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:42.771141 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:42.798970 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:40:42.801264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8744f8e-99df-4383-948b-d82ed0e0fa7e" -d '{"events": [{"server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "name": "network-vif-plugged", "status": "completed", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:40:42.814830 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a12f03dc-a349-4d18-ab3d-892783e7a575,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:40:42.865919 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:42.943190 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:42.994257 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:40:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ccd7af9-ebbf-4d33-bb39-d46915134ada x-openstack-request-id: req-0ccd7af9-ebbf-4d33-bb39-d46915134ada {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:40:42.994649 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "name": "network-vif-plugged", "status": "completed", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:40:42.994901 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-0ccd7af9-ebbf-4d33-bb39-d46915134ada {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:40:42.995290 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'code': 200} Sep 03 11:40:43.243921 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee2c0d7-5367-4bdd-aa2e-2d545a69b291 req-4fc9cf09-2d64-43de-91bb-77bb204e073c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:43.245432 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ee2c0d7-5367-4bdd-aa2e-2d545a69b291 req-4fc9cf09-2d64-43de-91bb-77bb204e073c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0519545 Sep 03 11:40:43.285183 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5ee2c0d7-5367-4bdd-aa2e-2d545a69b291 req-f20f931e-4209-459a-b352-88566b5cb015 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338094 Sep 03 11:40:43.348891 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f194830-a169-4489-b42d-277d07f0c9ef req-81b89326-4c44-4b04-bbb7-01fe74edebc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:43.350724 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f194830-a169-4489-b42d-277d07f0c9ef req-81b89326-4c44-4b04-bbb7-01fe74edebc1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1099 time: 0.0408676 Sep 03 11:40:43.385390 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f194830-a169-4489-b42d-277d07f0c9ef req-70c117b2-fa89-4bd8-bd6f-8dbf2c0fc354 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0278203 Sep 03 11:40:43.818267 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:44.402102 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5186891-2fb7-4d65-b151-aa4b864aeec9 req-0d52182d-fda3-4631-af19-89e6b116c7e7 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:44.403601 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a5186891-2fb7-4d65-b151-aa4b864aeec9 req-0d52182d-fda3-4631-af19-89e6b116c7e7 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0483406 Sep 03 11:40:44.444716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a5186891-2fb7-4d65-b151-aa4b864aeec9 req-5287a459-ba8c-44b4-b50e-2fcc68533f5a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0351701 Sep 03 11:40:45.557825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ee568a-d480-440c-8991-b836d8cf729c req-09a10485-6ca8-461d-8793-0ddad687eac8 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:45.559640 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-26ee568a-d480-440c-8991-b836d8cf729c req-09a10485-6ca8-461d-8793-0ddad687eac8 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0493479 Sep 03 11:40:45.596795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-26ee568a-d480-440c-8991-b836d8cf729c req-9129da23-a300-495c-b3f6-1717fb5b8359 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312860 Sep 03 11:40:45.708678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-322581b9-56e1-4ab1-8921-b3ad3cffc5a1 req-483b1f7b-d3de-457f-958c-cd5ef20d7d95 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:45.710130 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-322581b9-56e1-4ab1-8921-b3ad3cffc5a1 req-483b1f7b-d3de-457f-958c-cd5ef20d7d95 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0497174 Sep 03 11:40:45.746515 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-322581b9-56e1-4ab1-8921-b3ad3cffc5a1 req-e2f5393f-2612-4425-a043-976287dad9cc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303183 Sep 03 11:40:45.768865 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41112) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:45.944285 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec5404f7-7a6e-4cd6-b082-224b8295e91a tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:45.945767 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ec5404f7-7a6e-4cd6-b082-224b8295e91a tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1094 time: 0.1759765 Sep 03 11:40:45.949187 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41116) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:45.953448 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'port_id': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address': '172.20.0.10'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:40:46.041128 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:46.139736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:46.244726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.27.0.17 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/78b0414c-8e44-42e6-81ac-728b5cf2e0d5) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:40:46.342562 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:46.431884 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:46.465869 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:40:46.468678 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:40:46.472093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:40:46.504090 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=78b0414c-8e44-42e6-81ac-728b5cf2e0d5,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:46.516567 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.516911 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.517251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.517587 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.517929 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.518263 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.518599 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.518924 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.519247 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.519565 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.519886 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.520203 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:40:46.831343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.007445 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.151145 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.225183 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.299151 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=78b0414c-8e44-42e6-81ac-728b5cf2e0d5,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:47.311208 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.407166 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP adcd290d-92d4-4506-82f6-bb4dab7f5eb6 associated. External IP: 172.27.0.17, port: a12f03dc-a349-4d18-ab3d-892783e7a575. Sep 03 11:40:47.603752 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:40:47.707747 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:40:47.718455 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:40:47.730574 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:47.730574 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:40:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:47.801108 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:47.834370 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-ca9f1813-d116-4946-af9e-a8f8e810619f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8841507 Sep 03 11:40:47.835089 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:40:47.838060 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78095de0-abc4-4f3d-b897-bd561b698bbf" -d '{"events": [{"name": "network-changed", "server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:40:47.875820 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:40:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-483fdad2-84ac-4c23-9465-daee2ae39fd1 x-openstack-request-id: req-483fdad2-84ac-4c23-9465-daee2ae39fd1 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:40:47.876014 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:40:47.876258 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-483fdad2-84ac-4c23-9465-daee2ae39fd1 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:40:47.876664 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'status': 'completed', 'code': 200} Sep 03 11:40:47.940188 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-9473937c-5021-4e10-b7c6-57368fc1118a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:47.941911 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-9473937c-5021-4e10-b7c6-57368fc1118a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1099 time: 0.0428596 Sep 03 11:40:47.967505 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:48.040700 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-b53fd0bf-7a53-4805-9ac8-eca0d04cadfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:48.042179 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-b53fd0bf-7a53-4805-9ac8-eca0d04cadfb service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0929916 Sep 03 11:40:48.116140 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-f2f460c8-4aa8-47cd-b1a6-9235d5148f71 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 200 len: 999 time: 0.0666265 Sep 03 11:40:48.171453 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-2b61196f-7afd-4a3e-9d35-be61907751f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:48.172982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-2b61196f-7afd-4a3e-9d35-be61907751f8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0500393 Sep 03 11:40:48.206097 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'adcd290d-92d4-4506-82f6-bb4dab7f5eb6', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.17', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:0c:c7:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:40:46Z', 'updated_at': '2021-09-03T11:40:46Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:48.220080 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-c432263a-f370-4f04-b888-cb9ee448f8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:40:48.223287 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-c432263a-f370-4f04-b888-cb9ee448f8c1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0418072 Sep 03 11:40:48.236070 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:40:48.244689 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:40:48.245314 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:40:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:48.315899 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-83374cdd-5b20-463f-a667-f088e694401d service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871744 Sep 03 11:40:48.356679 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:40:48.409410 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-78095de0-abc4-4f3d-b897-bd561b698bbf req-b11448f9-afbc-43e5-b413-d1d5f2835790 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867171 Sep 03 11:40:48.581459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'adcd290d-92d4-4506-82f6-bb4dab7f5eb6', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.17', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:0c:c7:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:40:46Z', 'updated_at': '2021-09-03T11:40:46Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:40:48.610578 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12a93050-72db-48ca-8fda-b7961d746fe2 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'adcd290d-92d4-4506-82f6-bb4dab7f5eb6', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.17', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 651, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:0c:c7:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:40:46Z', 'updated_at': '2021-09-03T11:40:46Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:40:48.791058 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47aff09b-5be6-4099-935f-219b99a69fa6 None None] New status for floating IP adcd290d-92d4-4506-82f6-bb4dab7f5eb6: ACTIVE {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:40:52.430134 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41168) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:52.541745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a853349-2a08-4440-b9d3-644a3a9ec4fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.625717 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a853349-2a08-4440-b9d3-644a3a9ec4fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.676718 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a853349-2a08-4440-b9d3-644a3a9ec4fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.715404 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3a853349-2a08-4440-b9d3-644a3a9ec4fb admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=757a6515be5443c188a96d107d7c2d30&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2841680 Sep 03 11:40:52.716602 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a853349-2a08-4440-b9d3-644a3a9ec4fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=841a3019-19e0-4a1e-a044-83397171af16,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:52.718110 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41172) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:52.767850 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.791481 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.888252 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.890850 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:52.891992 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/841a3019-19e0-4a1e-a044-83397171af16 HTTP/1.1" status: 204 len: 168 time: 0.1721857 Sep 03 11:40:52.900332 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4afb373-c56a-475a-bdf8-057ea1e2c1a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=841a3019-19e0-4a1e-a044-83397171af16,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:53.366805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41178) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:53.380448 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c6a15dbe-cc83-4576-b1b4-b6ac7ccec5f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.464304 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c6a15dbe-cc83-4576-b1b4-b6ac7ccec5f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.531770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c6a15dbe-cc83-4576-b1b4-b6ac7ccec5f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.568923 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c6a15dbe-cc83-4576-b1b4-b6ac7ccec5f2 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b5c3f5f948094e78932d0b96bdc994bf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2009966 Sep 03 11:40:53.570825 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a15dbe-cc83-4576-b1b4-b6ac7ccec5f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e453bb6f-fced-4e4a-9ea8-28b0f7f0c093,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:53.571671 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41180) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:53.620952 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.641546 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.659492 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-60d6d26f-9197-4265-a295-e6a91cf87711 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.756709 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.759703 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:53.760889 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/e453bb6f-fced-4e4a-9ea8-28b0f7f0c093 HTTP/1.1" status: 204 len: 168 time: 0.1882179 Sep 03 11:40:53.768833 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c617c75a-3ebd-4423-903b-ae27751de0cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e453bb6f-fced-4e4a-9ea8-28b0f7f0c093,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:54.454037 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41188) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:54.467585 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d0635996-5207-4e02-a6bc-c7c653b0299f admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.551906 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d0635996-5207-4e02-a6bc-c7c653b0299f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.619530 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-d0635996-5207-4e02-a6bc-c7c653b0299f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.657306 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-d0635996-5207-4e02-a6bc-c7c653b0299f admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=86a5d7fc99c547fe81216727caa78bb4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2021639 Sep 03 11:40:54.658170 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0635996-5207-4e02-a6bc-c7c653b0299f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8862f98c-a801-47b2-99b0-807eb19b17ab,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:54.660595 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41190) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:40:54.713620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.733503 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.827124 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.829679 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:54.830887 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/8862f98c-a801-47b2-99b0-807eb19b17ab HTTP/1.1" status: 204 len: 168 time: 0.1690097 Sep 03 11:40:54.838998 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43fe42cb-e022-4e16-b55c-e4b4f38c8da2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8862f98c-a801-47b2-99b0-807eb19b17ab,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:40:56.326282 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4fbf88df-e3fc-4f27-bb21-aa2e9c826da6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:56.720667 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:57.659375 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:40:57.943143 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:40:59.080960 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:01.745341 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41266) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:01.844655 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-53eb2b4b-6059-4342-8099-35a2fe0ab268 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:01.929507 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-53eb2b4b-6059-4342-8099-35a2fe0ab268 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.030877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-53eb2b4b-6059-4342-8099-35a2fe0ab268 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.069528 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-53eb2b4b-6059-4342-8099-35a2fe0ab268 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=7d08f1ed58d1400685120dae801dbe53&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3231325 Sep 03 11:41:02.070363 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53eb2b4b-6059-4342-8099-35a2fe0ab268 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10ec2ed0-4ce7-4fc7-8ada-da8ff7b95187,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:02.072367 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41270) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:02.122782 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.142770 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.253605 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.256197 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.257349 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/10ec2ed0-4ce7-4fc7-8ada-da8ff7b95187 HTTP/1.1" status: 204 len: 168 time: 0.1840539 Sep 03 11:41:02.265870 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cef6746-58bd-4b18-bcfc-0db7814f720e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10ec2ed0-4ce7-4fc7-8ada-da8ff7b95187,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:02.772652 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41276) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:02.786121 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1160689b-de24-46c5-8c98-a590feba3d63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.875329 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1160689b-de24-46c5-8c98-a590feba3d63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.943256 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1160689b-de24-46c5-8c98-a590feba3d63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:02.980991 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1160689b-de24-46c5-8c98-a590feba3d63 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=47919912807f4fe6bcd4013467867f69&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2071676 Sep 03 11:41:02.982867 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1160689b-de24-46c5-8c98-a590feba3d63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f02069dc-2495-47b4-87c3-06345eb447a9,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:02.983614 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41278) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:03.032786 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:03.054166 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:03.177457 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:03.180069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:03.181217 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/f02069dc-2495-47b4-87c3-06345eb447a9 HTTP/1.1" status: 204 len: 168 time: 0.1965549 Sep 03 11:41:03.189205 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad578ed-fd17-46ad-bf47-1aa1a84cbccb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f02069dc-2495-47b4-87c3-06345eb447a9,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:13.845935 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:14.485328 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-a1ac7b69-2546-4d2d-9e8a-42697d83f92c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385273 Sep 03 11:41:14.566568 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-1014e9c6-d821-4ece-bd80-c000d13e757d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:41:14.568034 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-1014e9c6-d821-4ece-bd80-c000d13e757d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1099 time: 0.0404305 Sep 03 11:41:14.673420 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-ec3232b7-71bd-4989-a2ab-6a121ec0a624 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:41:14.674904 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-ec3232b7-71bd-4989-a2ab-6a121ec0a624 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0848234 Sep 03 11:41:14.738831 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-a4f7d5b8-a195-49b9-913a-9c3759e761b5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 200 len: 1001 time: 0.0554645 Sep 03 11:41:14.786785 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-67b440bf-1d7a-4623-af32-b1d9f8fee3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:41:14.788192 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-67b440bf-1d7a-4623-af32-b1d9f8fee3ad service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0418198 Sep 03 11:41:14.837342 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-6d215ac7-bd4a-4967-8a0a-5d167a789db7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:41:14.838865 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-6d215ac7-bd4a-4967-8a0a-5d167a789db7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0435841 Sep 03 11:41:14.925271 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-6dd30521-bb09-4b36-8053-827f0ceb488c service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785837 Sep 03 11:41:15.019887 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8e334fe7-920b-4ddb-90a2-312eba35c030 req-813006ac-f086-45e8-b55b-a6e0f0adb80a service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865619 Sep 03 11:41:23.710257 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0145f65d-4193-4a8d-9d00-628b74d25c9e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:26.338957 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-79d1815d-a65d-45d3-8476-fc9c5148842d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:26.733073 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:27.676060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:28.485127 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41414) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:28.616728 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-149195e1-1b73-4d89-afe9-a4d87f647e33 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:28.718305 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-149195e1-1b73-4d89-afe9-a4d87f647e33 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:28.795823 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-149195e1-1b73-4d89-afe9-a4d87f647e33 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:28.838126 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-149195e1-1b73-4d89-afe9-a4d87f647e33 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c69d5c34a21342e6afd8f89de4d15d04&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3519158 Sep 03 11:41:28.839130 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-149195e1-1b73-4d89-afe9-a4d87f647e33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a2dfd99-4c46-4451-8468-4d750adac9cc,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:28.842167 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41418) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:28.892613 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:28.915365 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:29.035821 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:29.038368 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:29.039547 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/3a2dfd99-4c46-4451-8468-4d750adac9cc HTTP/1.1" status: 204 len: 168 time: 0.1961815 Sep 03 11:41:29.050862 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501ef0eb-0e7d-424a-937d-419f31d8f70e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a2dfd99-4c46-4451-8468-4d750adac9cc,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:29.100340 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:34.941906 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:41:40.086550 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41536) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:40.187841 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.272940 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.349567 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.387477 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=c530fde743de4ddf8915982759142c2e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2998352 Sep 03 11:41:40.388541 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19d17b07-9b4a-480b-96ad-9037abdfd7e2,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:40.390206 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41540) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:40.395621 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.395974 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.396313 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.396649 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.396981 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.397312 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.397640 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.397967 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.398342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.398642 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.398962 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.399282 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0c0f281d-4a58-4ce9-b3fd-6675f5d38eb5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:41:40.437811 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.461847 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.576928 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.579433 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:40.580582 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/19d17b07-9b4a-480b-96ad-9037abdfd7e2 HTTP/1.1" status: 204 len: 168 time: 0.1893148 Sep 03 11:41:40.587962 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7a1208-51c9-4e81-9ff9-ff1dfc1df098 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19d17b07-9b4a-480b-96ad-9037abdfd7e2,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:41.194619 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41546) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:41.207895 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b7aa1a9a-3808-4893-a276-dd5c1eaec82c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.293966 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b7aa1a9a-3808-4893-a276-dd5c1eaec82c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.372536 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b7aa1a9a-3808-4893-a276-dd5c1eaec82c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.411008 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7aa1a9a-3808-4893-a276-dd5c1eaec82c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe78fdbd-f414-4af1-8656-8bc7b8e5aabe,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:41.415919 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-b7aa1a9a-3808-4893-a276-dd5c1eaec82c admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=b830d161713c4aa58c8ccd1c07304cf1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2195671 Sep 03 11:41:41.418663 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41548) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:41.467331 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.488570 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.601329 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.603908 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] Notify callbacks [] for security_group, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:41.605044 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/fe78fdbd-f414-4af1-8656-8bc7b8e5aabe HTTP/1.1" status: 204 len: 168 time: 0.1855104 Sep 03 11:41:41.613499 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1835028b-4148-47d9-908f-b6ae13d6eede admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe78fdbd-f414-4af1-8656-8bc7b8e5aabe,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:42.232534 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41554) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:42.245760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-514986ff-8ce8-4fbb-987d-d804d81ffbde admin admin] Notify callbacks [] for security_group, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.331796 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-514986ff-8ce8-4fbb-987d-d804d81ffbde admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.395768 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-514986ff-8ce8-4fbb-987d-d804d81ffbde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.432775 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-514986ff-8ce8-4fbb-987d-d804d81ffbde admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=710578616725406da8eba4912ad575c0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1991477 Sep 03 11:41:42.434998 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514986ff-8ce8-4fbb-987d-d804d81ffbde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d524886b-4059-49a7-a638-4942baa578d7,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:42.440779 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41556) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:41:42.487191 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.508024 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.624399 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.626972 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:42.628123 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/d524886b-4059-49a7-a638-4942baa578d7 HTTP/1.1" status: 204 len: 168 time: 0.1902266 Sep 03 11:41:42.635627 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-912f436e-3243-4fbc-a6aa-43a9995bfd64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d524886b-4059-49a7-a638-4942baa578d7,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:41:43.852533 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:53.675496 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-1afa030c-3193-499d-b0bb-d9b4c6130f83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:56.327080 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-de83301b-956f-4e63-be96-a32bb3a6d00d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:56.709798 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:57.715550 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:41:59.121101 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:11.941776 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:42:13.876102 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:14.610637 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-e33ecafe-3ec2-41ca-8d49-52947f2eb72f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0401342 Sep 03 11:42:14.694599 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-34636579-fcd6-4726-8698-6bd7aa33cc4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:14.696148 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-34636579-fcd6-4726-8698-6bd7aa33cc4b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 1099 time: 0.0437560 Sep 03 11:42:14.797571 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-1d932357-45b3-41f4-b285-9410491bf322 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:14.799148 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-1d932357-45b3-41f4-b285-9410491bf322 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0825849 Sep 03 11:42:15.122099 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-bffef862-065b-4cbb-8a40-290e76a7e0b4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 200 len: 1001 time: 0.3159373 Sep 03 11:42:15.169578 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-7bfe84b6-558c-4142-a5dc-2efb67db0be5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:15.171022 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-7bfe84b6-558c-4142-a5dc-2efb67db0be5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0414476 Sep 03 11:42:15.216135 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-0623c0dd-46b0-40f9-938c-6ff1beb07de2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:15.217620 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-0623c0dd-46b0-40f9-938c-6ff1beb07de2 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0389006 Sep 03 11:42:15.305420 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-12e51826-a854-4169-9dbc-6587fe134d15 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809376 Sep 03 11:42:15.392444 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b599d72f-7894-4a70-979a-a19c8d6fb0e0 req-10f682c6-f63e-437e-a33d-39ecaa85089f service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792983 Sep 03 11:42:23.691704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-0ff19ced-0b50-443c-bc9d-1a9e31c667fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:26.331682 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b0e9ff19-219d-438b-8d31-5b7a2ae33673 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:26.726278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:27.692305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:29.143287 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:43.851669 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:46.340590 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac3a634-5ab7-4b18-b3b3-4d1b8919b107 req-fe6f2e4c-c528-41ac-a8b4-7134a0439a6d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:46.342052 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ac3a634-5ab7-4b18-b3b3-4d1b8919b107 req-fe6f2e4c-c528-41ac-a8b4-7134a0439a6d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0526311 Sep 03 11:42:46.380374 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0ac3a634-5ab7-4b18-b3b3-4d1b8919b107 req-504c3cca-6e21-4366-9c80-55d2c47982ef tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317414 Sep 03 11:42:47.511091 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bb4e67-710a-45b9-b4a2-6188d91d2836 req-9c1b12f0-937f-48c5-afff-de2086ccadbf tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:47.512537 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25bb4e67-710a-45b9-b4a2-6188d91d2836 req-9c1b12f0-937f-48c5-afff-de2086ccadbf tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0483687 Sep 03 11:42:47.550690 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-25bb4e67-710a-45b9-b4a2-6188d91d2836 req-5a426d11-06be-4c74-a773-6b8313c2e1e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321558 Sep 03 11:42:47.844082 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-6ee071a0-ece8-4243-92ef-0c6fca46643b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:47.845582 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-6ee071a0-ece8-4243-92ef-0c6fca46643b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 946 time: 0.0502164 Sep 03 11:42:47.935156 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port a12f03dc-a349-4d18-ab3d-892783e7a575 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:42:47.935489 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.022196 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] For port a12f03dc-a349-4d18-ab3d-892783e7a575, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=a12f03dc-a349-4d18-ab3d-892783e7a575,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:42:48.022581 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.197513 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.197872 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.198186 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP adcd290d-92d4-4506-82f6-bb4dab7f5eb6 disassociated. External IP: 172.27.0.17, port: a12f03dc-a349-4d18-ab3d-892783e7a575. Sep 03 11:42:48.198562 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for a12f03dc-a349-4d18-ab3d-892783e7a575 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:42:48.383301 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.415399 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=a12f03dc-a349-4d18-ab3d-892783e7a575,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:42:48.427598 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.427871 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.428210 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.428543 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.428871 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.429197 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.429519 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.429839 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.430160 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.430510 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.430827 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.431141 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:42:48.533580 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:42:48.664559 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f06523b0-805d-4975-9b18-03c01d607978 req-34db2a43-617e-4537-8dc1-1a0f190d619e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 210 time: 0.0330219 Sep 03 11:42:48.665513 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:42:48.685161 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:42:48.687466 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:42:48.688146 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:42:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:42:48.706095 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] No DVR routers for this DVR port a12f03dc-a349-4d18-ab3d-892783e7a575 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:42:48.708657 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:48.710667 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-622cad8d-f774-4e1d-a22b-c069085bd06f req-b07a094d-1598-4494-bbc6-fb55fad859ba tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "DELETE /v2.0/ports/a12f03dc-a349-4d18-ab3d-892783e7a575 HTTP/1.1" status: 204 len: 173 time: 0.8581712 Sep 03 11:42:48.711116 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'name': 'network-vif-deleted', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:42:48.713393 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25143562-29df-4053-a962-d7c35767c4e8" -d '{"events": [{"server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "name": "network-vif-deleted", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:42:48.808548 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:42:48.941281 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:42:49.003451 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:42:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93888c55-6192-4dbd-b474-9327f4fa1242 x-openstack-request-id: req-93888c55-6192-4dbd-b474-9327f4fa1242 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:42:49.003758 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3765a53f-bd86-49b2-acc7-6f77ee342181", "name": "network-vif-deleted", "tag": "a12f03dc-a349-4d18-ab3d-892783e7a575", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:42:49.004007 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-93888c55-6192-4dbd-b474-9327f4fa1242 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:42:49.004399 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3765a53f-bd86-49b2-acc7-6f77ee342181', 'name': 'network-vif-deleted', 'tag': 'a12f03dc-a349-4d18-ab3d-892783e7a575', 'status': 'completed', 'code': 200} Sep 03 11:42:49.024752 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:42:49.054652 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:42:49.063186 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:42:49.063786 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:42:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:42:49.169913 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:42:49.366673 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:42:49.391652 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f240da89-39a6-46d9-bbf5-5396bfc905b2 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:42:49.611271 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5e401af-4c17-4757-8e61-2eed51711425 None None] New status for floating IP adcd290d-92d4-4506-82f6-bb4dab7f5eb6: DOWN {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:42:49.771449 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-739a870b-57ae-4013-97ec-31a650d65036 req-19a7136d-1a16-47d2-b351-8b19b1df5430 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=3765a53f-bd86-49b2-acc7-6f77ee342181 HTTP/1.1" status: 200 len: 210 time: 0.0266788 Sep 03 11:42:51.013216 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-71387c42-157c-40fe-9d9a-ee2b27a1c773 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2099587690&fields=id&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 267 time: 0.0325725 Sep 03 11:42:51.127474 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-a07669ca-9ef1-4a70-b734-45f90af5fcd1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:51.128936 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-a07669ca-9ef1-4a70-b734-45f90af5fcd1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.1084509 Sep 03 11:42:51.143943 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-0a419532-e0bc-474f-b36d-feb0efe0a0cd tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/quotas/278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 375 time: 0.0094132 Sep 03 11:42:51.195582 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-dc2fdefa-4de9-4382-9ce2-ead10427ff47 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0465074 Sep 03 11:42:51.253800 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a12f03dc-a349-4d18-ab3d-892783e7a575 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:42:51.294892 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-cc578de5-e9a6-4c7a-bdb4-900c6d3c5725 service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875316 Sep 03 11:42:51.390818 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-cb6abfa1-65bf-46c1-9192-de8527c130bc service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886893 Sep 03 11:42:51.404052 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: a12f03dc-a349-4d18-ab3d-892783e7a575 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:42:51.404335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device a12f03dc-a349-4d18-ab3d-892783e7a575 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:42:51.933615 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-49607f9b-c505-4c4c-964c-5743a90b8256 req-74d0dff0-4d75-4d29-b378-ec82b666116d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 210 time: 0.0262341 Sep 03 11:42:53.033979 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-da4c71e7-d0ef-4b34-a14e-9b56603574ee req-ddd2a881-6f6c-4423-8b55-5b56aa3484fa tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 210 time: 0.0266693 Sep 03 11:42:53.684791 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2a2cfbce-9333-4852-8410-cbd7ca19720c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:53.692283 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-e79e1a74-33b6-485e-8b32-f04e42119074 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:53.694046 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-e79e1a74-33b6-485e-8b32-f04e42119074 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.1137655 Sep 03 11:42:53.737344 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-12bb8cc3-b753-4536-b910-e7da75b56568 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 380 time: 0.0347056 Sep 03 11:42:53.746490 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'port': {'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'admin_state_up': True, 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'security_groups': ['ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:42:53.914443 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Made reservation on behalf of 278d3bede8a94c32bc0dfdbdfb5259be for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:42:53.918483 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.041770 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.20.0.3 (c04d12f4-d98f-4e8c-96f9-c0e3c121f28f/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85/1bf88c07-cb79-47fb-b90c-89309f3eff39) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:42:54.169770 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-662e0390-a25a-4350-baae-a5368da003ed req-94af5f5b-4ebd-4e03-b0ab-095073dc7ead tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 210 time: 0.0519700 Sep 03 11:42:54.214248 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.228886 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Transition to ACTIVE for port object 1bf88c07-cb79-47fb-b90c-89309f3eff39 will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:42:54.326268 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.370402 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:42:54.373460 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:42:54.377635 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:42:54.408327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:42:54.435720 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:54.436360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.538215 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-ff5dad75-0fcf-46d4-b844-ce55fdcf4ab0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7953196 Sep 03 11:42:54.550740 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Request body: {'port': {'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:42:54.602560 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.697234 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-4cb2ce6f-f867-4091-a993-9cd4051bc3f3 None None] Provisioning for port 1bf88c07-cb79-47fb-b90c-89309f3eff39 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:42:54.701409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-4cb2ce6f-f867-4091-a993-9cd4051bc3f3 None None] Provisioning complete for port 1bf88c07-cb79-47fb-b90c-89309f3eff39 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:42:54.707731 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4cb2ce6f-f867-4091-a993-9cd4051bc3f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.736336 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-4cb2ce6f-f867-4091-a993-9cd4051bc3f3 None None] Port 1bf88c07-cb79-47fb-b90c-89309f3eff39 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:42:54.861980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1bf88c07-cb79-47fb-b90c-89309f3eff39 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:42:54.869381 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:54.882006 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Transition to ACTIVE for port object 1bf88c07-cb79-47fb-b90c-89309f3eff39 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:42:54.941979 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:55.009629 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Pushing event updated for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:42:55.060789 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Attempting to bind port 1bf88c07-cb79-47fb-b90c-89309f3eff39 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:42:55.066622 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Attempting to bind port 1bf88c07-cb79-47fb-b90c-89309f3eff39 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:42:55.066622 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Attempting to bind port 1bf88c07-cb79-47fb-b90c-89309f3eff39 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:42:55.066622 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Port 1bf88c07-cb79-47fb-b90c-89309f3eff39 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:42:55.066964 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Attempting to bind port 1bf88c07-cb79-47fb-b90c-89309f3eff39 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:42:55.072101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:42:55.072429 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:42:55.072805 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Bound using segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:42:55.073332 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Bound port: 1bf88c07-cb79-47fb-b90c-89309f3eff39, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:42:55.073683 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:55.146750 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:42:55.149975 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:42:55.232583 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:55.286143 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.286799 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:55.288210 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] 10.222.0.11 "PUT /v2.0/ports/1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 1093 time: 0.7424843 Sep 03 11:42:55.288659 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:42:55.290949 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08" -d '{"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:42:55.321877 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda661e9-5e39-4fc9-bb58-0fbdf54d142c service neutron] Pushing event updated for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:42:55.337668 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8910b1-78e3-4b28-b35f-60f0bfbc1319 req-ef5c5fdf-5d7a-47a8-ac6c-d516ee041f31 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.339279 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7a8910b1-78e3-4b28-b35f-60f0bfbc1319 req-ef5c5fdf-5d7a-47a8-ac6c-d516ee041f31 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0995922 Sep 03 11:42:55.340801 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:42:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c241cc9f-f2a4-42c3-a885-85c64f390c37 x-openstack-request-id: req-c241cc9f-f2a4-42c3-a885-85c64f390c37 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:42:55.341091 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:42:55.341343 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c241cc9f-f2a4-42c3-a885-85c64f390c37 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:42:55.341735 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'status': 'completed', 'code': 200} Sep 03 11:42:55.415991 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7a8910b1-78e3-4b28-b35f-60f0bfbc1319 req-df5ee248-847d-436e-a689-024ab1f00974 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680597 Sep 03 11:42:55.426477 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-e5939211-b7b8-43e0-b227-aa69405939ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.428352 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-e5939211-b7b8-43e0-b227-aa69405939ca service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1096 time: 0.0732980 Sep 03 11:42:55.528584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-4e61eb09-e624-4895-815c-ab3d3f124fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.529982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-4e61eb09-e624-4895-815c-ab3d3f124fd3 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0941362 Sep 03 11:42:55.620033 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-1d1a3a7a-3578-419b-b49f-83b1378511bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.621405 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-99cf337e-acf2-42d4-b5cf-5edd3d2b2a08 req-1d1a3a7a-3578-419b-b49f-83b1378511bf service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0845368 Sep 03 11:42:55.700251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-23078402-a701-403d-9e05-8946857071d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.701768 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-23078402-a701-403d-9e05-8946857071d8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1096 time: 0.0448420 Sep 03 11:42:55.745377 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-671c6d62-cfec-4c00-86fe-c2f568278421 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 217 time: 0.0363009 Sep 03 11:42:55.792626 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-fe368faf-9a82-435c-9131-82d58080705f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.793921 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-fe368faf-9a82-435c-9131-82d58080705f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0409751 Sep 03 11:42:55.838980 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-963225a6-ad17-4954-8eb5-52544e3b96bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:55.840394 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-963225a6-ad17-4954-8eb5-52544e3b96bb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0390358 Sep 03 11:42:55.931861 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-35f6ccd2-4795-44c4-a443-64589d8eaf33 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834997 Sep 03 11:42:56.020744 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33c9e09e-85d6-4052-8cfd-fb26bb291f24 req-4a755df4-c1cf-44fc-99bc-e05a5d3aa383 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0810661 Sep 03 11:42:56.360460 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8d3e4871-d5d4-4a4c-9da3-6c65ff208aca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:56.533989 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ac123f-a411-4869-88f7-3289445f8d3f req-bbdae158-7610-46fb-9693-b77cce97d15b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:56.535484 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8ac123f-a411-4869-88f7-3289445f8d3f req-bbdae158-7610-46fb-9693-b77cce97d15b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0520728 Sep 03 11:42:56.572490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b8ac123f-a411-4869-88f7-3289445f8d3f req-3ca24680-1818-40b3-9047-61089b37327f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312169 Sep 03 11:42:56.702715 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:57.679133 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:57.685475 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0678697b-b30c-4327-bde7-9d9ca8387ce9 req-4fc348b9-f6ab-4969-8839-ed5ebfa768e9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:57.688622 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0678697b-b30c-4327-bde7-9d9ca8387ce9 req-4fc348b9-f6ab-4969-8839-ed5ebfa768e9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0492382 Sep 03 11:42:57.725939 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0678697b-b30c-4327-bde7-9d9ca8387ce9 req-d58b442d-3730-4187-9d2d-c02e0322a59b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0330713 Sep 03 11:42:58.837492 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d9aee0-1936-40a3-a0f8-be56aa25bef6 req-de3db557-051f-43f0-b88c-1c8180b813e1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:58.838968 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-94d9aee0-1936-40a3-a0f8-be56aa25bef6 req-de3db557-051f-43f0-b88c-1c8180b813e1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0478404 Sep 03 11:42:58.876994 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-94d9aee0-1936-40a3-a0f8-be56aa25bef6 req-46596fbb-b661-49f9-ac22-c092645df79c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315046 Sep 03 11:42:59.091193 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:42:59.993850 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b150082-cceb-476d-95db-324856c88d7d req-d10e9cd5-3557-464d-a8db-347f4edbad31 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:42:59.995320 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4b150082-cceb-476d-95db-324856c88d7d req-d10e9cd5-3557-464d-a8db-347f4edbad31 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0515130 Sep 03 11:43:00.032795 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4b150082-cceb-476d-95db-324856c88d7d req-722cf97f-1f08-4b3c-b5c3-75befb7e0b9e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315812 Sep 03 11:43:01.147085 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a3d4fc-8381-4166-a3a6-9da70e427dc0 req-e06ae41e-5135-4219-a134-b70d230fd3bb tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:01.148541 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8a3d4fc-8381-4166-a3a6-9da70e427dc0 req-e06ae41e-5135-4219-a134-b70d230fd3bb tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0492222 Sep 03 11:43:01.185716 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a8a3d4fc-8381-4166-a3a6-9da70e427dc0 req-e99d02b6-4133-4b2b-b514-9e880ee852ff tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313318 Sep 03 11:43:02.299452 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef9fee5-ea3f-48cd-abb8-1fb4cde27460 req-a3e18f4b-f71d-4e47-b124-654b7cffc3ca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:02.300895 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9ef9fee5-ea3f-48cd-abb8-1fb4cde27460 req-a3e18f4b-f71d-4e47-b124-654b7cffc3ca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0482414 Sep 03 11:43:02.337660 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9ef9fee5-ea3f-48cd-abb8-1fb4cde27460 req-57567304-fa01-43c1-944d-0479dc33edc2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310066 Sep 03 11:43:03.316701 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1bf88c07-cb79-47fb-b90c-89309f3eff39 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:43:03.414881 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:43:03.427547 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:43:03.457548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03fee59-40fb-43f3-937b-70c662126940 req-db688f53-af1c-43b0-a974-dc6122650894 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:03.459226 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f03fee59-40fb-43f3-937b-70c662126940 req-db688f53-af1c-43b0-a974-dc6122650894 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 943 time: 0.0548916 Sep 03 11:43:03.464366 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:03.477629 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1bf88c07-cb79-47fb-b90c-89309f3eff39 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:43:03.497002 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:43:03.497576 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f03fee59-40fb-43f3-937b-70c662126940 req-2a11cdff-e4c5-46a5-a1ab-6f00fe6ca709 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319300 Sep 03 11:43:03.576109 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:03.627254 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:43:03.634010 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.637437 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:43:03.783915 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['1bf88c07-cb79-47fb-b90c-89309f3eff39'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:43:04.610237 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9ac76a-ad33-4bb4-8f78-3fa4a49d673b req-ffc85436-21ff-49ca-a1e4-2e921edb0772 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:04.611740 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f9ac76a-ad33-4bb4-8f78-3fa4a49d673b req-ffc85436-21ff-49ca-a1e4-2e921edb0772 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 944 time: 0.0490422 Sep 03 11:43:04.649368 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5f9ac76a-ad33-4bb4-8f78-3fa4a49d673b req-6e09bb1c-1f9b-4eb2-afba-5f7f6b170b78 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0317810 Sep 03 11:43:05.333014 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1bf88c07-cb79-47fb-b90c-89309f3eff39 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:43:05.416734 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 1bf88c07-cb79-47fb-b90c-89309f3eff39 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:43:05.420578 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 1bf88c07-cb79-47fb-b90c-89309f3eff39 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:43:05.420959 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:05.500689 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:05.522724 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:43:05.524969 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c6e3e5f-9b62-4a61-aee4-372b4e09bf37" -d '{"events": [{"server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "name": "network-vif-plugged", "status": "completed", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:43:05.540328 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:43:05.561927 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:43:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dba11d48-7d5e-49b3-b271-8792b9bc75d7 x-openstack-request-id: req-dba11d48-7d5e-49b3-b271-8792b9bc75d7 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:43:05.562887 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "name": "network-vif-plugged", "status": "completed", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:43:05.563161 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-dba11d48-7d5e-49b3-b271-8792b9bc75d7 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:43:05.563528 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'code': 200} Sep 03 11:43:05.599286 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:05.645740 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:43:05.765452 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa06eca0-a054-4706-a4d5-75fbad82ba7f req-027a87b1-927c-4de9-875f-1dcd29187976 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:05.766899 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-aa06eca0-a054-4706-a4d5-75fbad82ba7f req-027a87b1-927c-4de9-875f-1dcd29187976 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0518703 Sep 03 11:43:05.805220 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-aa06eca0-a054-4706-a4d5-75fbad82ba7f req-a9621eaa-2758-4cd3-9da9-38abc40fdbb7 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321419 Sep 03 11:43:05.862839 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9965bcec-18e0-460d-86e2-a21e8de13e21 req-1343e3f8-dc47-4d88-a452-5c279e3c66bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:05.864265 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9965bcec-18e0-460d-86e2-a21e8de13e21 req-1343e3f8-dc47-4d88-a452-5c279e3c66bf service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0418847 Sep 03 11:43:05.897985 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9965bcec-18e0-460d-86e2-a21e8de13e21 req-4c8e9eec-0888-4d04-8039-40134296026e service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0269690 Sep 03 11:43:06.923616 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6decdb11-5e99-43df-a2b7-b71faedaa983 req-dfbd206b-299c-450d-8de5-13b93992d803 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:06.925079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6decdb11-5e99-43df-a2b7-b71faedaa983 req-dfbd206b-299c-450d-8de5-13b93992d803 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0495086 Sep 03 11:43:06.963177 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-6decdb11-5e99-43df-a2b7-b71faedaa983 req-b9dc7405-db4b-4511-8ae8-3e16a1a06623 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320530 Sep 03 11:43:08.077328 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d89d73-90e3-4124-8dbb-7ddde6786c5d req-e6bbce8e-2980-41c1-8567-e1b0741f55b3 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:08.078956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-00d89d73-90e3-4124-8dbb-7ddde6786c5d req-e6bbce8e-2980-41c1-8567-e1b0741f55b3 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0492859 Sep 03 11:43:08.121626 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-00d89d73-90e3-4124-8dbb-7ddde6786c5d req-e7df0336-5203-4ef0-b0d4-d9a21a53aaca tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311298 Sep 03 11:43:08.234973 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ba39eb-0c31-4518-8158-bb5d73db8bb2 req-97c93dbf-2c39-4b78-a8fc-665d60c6bed1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:08.236714 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-96ba39eb-0c31-4518-8158-bb5d73db8bb2 req-97c93dbf-2c39-4b78-a8fc-665d60c6bed1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0521746 Sep 03 11:43:08.273789 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-96ba39eb-0c31-4518-8158-bb5d73db8bb2 req-66340469-c439-4beb-ad35-5ff528a08411 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311177 Sep 03 11:43:08.295695 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41660) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:43:08.333798 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c07d46f2-b954-426d-8aae-88827866a5be tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:08.335277 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c07d46f2-b954-426d-8aae-88827866a5be tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1093 time: 0.0386231 Sep 03 11:43:08.337938 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41662) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:43:08.342230 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address': '172.20.0.3'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:43:08.422252 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:08.520219 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:08.624861 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.27.0.230 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/10bfed72-c466-436e-9566-ba577d50ec12) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:43:08.729167 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:08.828381 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:08.863838 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:43:08.866687 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:43:08.870081 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:43:08.899442 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=10bfed72-c466-436e-9566-ba577d50ec12,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:43:09.479739 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:09.593968 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:09.741398 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:09.828071 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:09.898276 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=10bfed72-c466-436e-9566-ba577d50ec12,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:43:09.907954 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:10.005024 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.db.l3_db [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP b6a67955-e743-4ef0-a0ee-cec0b5928d58 associated. External IP: 172.27.0.230, port: 1bf88c07-cb79-47fb-b90c-89309f3eff39. Sep 03 11:43:10.208273 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:43:10.310939 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:43:10.321108 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:43:10.331245 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:43:10.342077 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:42:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:43:10.388586 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:10.416984 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-a543b06b-777e-4c9d-9472-99a19a928085 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0780220 Sep 03 11:43:10.458726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:43:10.458726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-573d633d-ba07-4f56-be5f-243dbb985a16" -d '{"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:43:10.459986 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:43:10.460371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:43:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b71bc860-9e3c-4b62-a4bb-ffbf28b5db41 x-openstack-request-id: req-b71bc860-9e3c-4b62-a4bb-ffbf28b5db41 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:43:10.460371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:43:10.460371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b71bc860-9e3c-4b62-a4bb-ffbf28b5db41 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:43:10.460371 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'status': 'completed', 'code': 200} Sep 03 11:43:10.526310 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-6a3cbed5-b415-4158-913d-a3cba3d423e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:10.527850 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-6a3cbed5-b415-4158-913d-a3cba3d423e3 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0438852 Sep 03 11:43:10.616911 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-743c68dd-fbd5-4036-8f16-cbe7dce6a3c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:10.618304 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-743c68dd-fbd5-4036-8f16-cbe7dce6a3c4 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0828607 Sep 03 11:43:10.660169 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:09Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:43:10.686180 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-c22d3cb3-552b-4265-b488-0a3a7ae1de9a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 999 time: 0.0605364 Sep 03 11:43:10.689704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:43:10.698069 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:43:10.698708 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:42:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:43:10.739618 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-e46551f7-c772-486b-b694-0b34b647384f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:10.741109 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-e46551f7-c772-486b-b694-0b34b647384f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0482516 Sep 03 11:43:10.786113 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-ee9555eb-3e88-4da6-a062-5b261a25689d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:10.790387 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-ee9555eb-3e88-4da6-a062-5b261a25689d service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0394466 Sep 03 11:43:10.806245 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:43:10.878469 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-561dad40-0554-4757-81dd-6dfbdd86b74a service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839119 Sep 03 11:43:10.965722 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-573d633d-ba07-4f56-be5f-243dbb985a16 req-156fb0d4-0b3a-454b-b7af-c51dc718bdeb service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805612 Sep 03 11:43:11.035028 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:09Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:43:11.061749 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d8750a-547b-42d9-958a-607ff6c6c7c9 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:09Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:43:11.240625 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e07ed776-adfb-40a1-b773-5f528564dd04 None None] New status for floating IP b6a67955-e743-4ef0-a0ee-cec0b5928d58: ACTIVE {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:43:13.845436 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:14.483920 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-b8d18afc-9e44-4643-a406-07b87e5ad68c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0398009 Sep 03 11:43:14.568959 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-0e883ce5-f1ec-4f87-af70-5b0e8d80df74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:14.570490 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-0e883ce5-f1ec-4f87-af70-5b0e8d80df74 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0452263 Sep 03 11:43:14.670752 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-fe308ed3-e3ba-4808-95f4-c916e2eb0027 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:14.671888 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-fe308ed3-e3ba-4808-95f4-c916e2eb0027 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0827076 Sep 03 11:43:14.738479 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-898ede0d-0590-4414-a032-68448e9080f3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 1001 time: 0.0597665 Sep 03 11:43:14.786543 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-384f052c-86dd-4e1b-bdf7-379bc69f1bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:14.787953 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-384f052c-86dd-4e1b-bdf7-379bc69f1bbb service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0429974 Sep 03 11:43:14.833444 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-d0fffa75-d6bf-4566-8581-86ee2d144aac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:43:14.834943 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-d0fffa75-d6bf-4566-8581-86ee2d144aac service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0406256 Sep 03 11:43:14.929862 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-5902e18a-a66e-4a54-b35c-29a0298af7f3 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881207 Sep 03 11:43:15.018410 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a27fd7fb-3a1e-4dff-88c5-b0574e6059c7 req-d8ee9018-4c83-4cf5-8b45-d0e109094bda service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811739 Sep 03 11:43:23.656746 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-aa378042-7a88-471a-96fe-87e5ba25a21a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:25.941057 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:43:26.353903 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-4583a91f-1132-4d6a-a707-b348af23243d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:26.708085 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:27.690859 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:29.107796 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:43.867551 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:53.718797 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-5a9e12cb-b29a-4cb9-9ef1-27a9116d340e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:56.370363 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-62df0747-b822-435e-a039-d8d15653b4df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:56.724190 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:57.707330 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:43:59.101307 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:02.941309 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:44:13.867264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:14.504066 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-13f03010-bd00-42c1-90cc-66f6467e4a3a service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0441344 Sep 03 11:44:14.584793 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-e86b2bdf-622b-4334-b01d-4dcd684a22de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:14.586255 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-e86b2bdf-622b-4334-b01d-4dcd684a22de service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0403938 Sep 03 11:44:14.686880 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-53814bdf-4a42-43b5-95f5-c5d4aeb93dd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:14.688337 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-53814bdf-4a42-43b5-95f5-c5d4aeb93dd8 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0839157 Sep 03 11:44:14.754811 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-40a71c1a-b851-444b-8298-ffcdc04ca363 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 1001 time: 0.0594063 Sep 03 11:44:14.802083 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-5a50bcdc-72ff-4a63-b44e-7ad14e187802 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:14.803587 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-5a50bcdc-72ff-4a63-b44e-7ad14e187802 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0417905 Sep 03 11:44:14.848024 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-3aca0381-d046-43c5-bbbd-b13215e2d0a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:14.853376 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-3aca0381-d046-43c5-bbbd-b13215e2d0a6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0392392 Sep 03 11:44:14.950210 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-1591a555-4045-496a-8547-d10ab985d8c6 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938709 Sep 03 11:44:15.041925 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-36bd1be2-cdba-486e-86b8-e1086e146a15 req-7ab63b4c-28cc-4fc0-a739-2ae68b36ea1b service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844841 Sep 03 11:44:23.678391 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-18161448-d50e-4392-b5ee-aa00a049ddc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:26.334692 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-92dc37ba-356f-4a74-bb0a-f5fb5b18cebf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:26.723803 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:27.678210 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:29.095217 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:39.941069 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:44:43.906424 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:45.185727 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-cf74331c-e2ad-43bf-8174-a83744c296f7 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2099587690&fields=id&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 267 time: 0.0366807 Sep 03 11:44:45.288584 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-fe03f4b1-422d-4e0b-8ddd-0c2dd31a1a6e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:45.290026 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-fe03f4b1-422d-4e0b-8ddd-0c2dd31a1a6e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.0969677 Sep 03 11:44:45.304293 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-eb6f1d2c-d6cf-4ab3-b683-4b75bc96224d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/quotas/278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 375 time: 0.0086734 Sep 03 11:44:45.362649 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-bab7c073-51fa-4898-a62a-dbcad73614aa tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0530241 Sep 03 11:44:45.486259 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-61536dc0-4638-43b2-95e6-de92ca4bd96b service neutron] http://10.222.0.16:9696/v2.0/extensions returned with HTTP 200 {{(pid=94433) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 03 11:44:45.487332 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-61536dc0-4638-43b2-95e6-de92ca4bd96b service neutron] 10.222.0.16 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1139688 Sep 03 11:44:45.575709 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-4b4c5946-1025-4add-ac92-08f30f8ee77b service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821216 Sep 03 11:44:45.670566 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-2693648f-65dd-4b4f-88b5-0f96d53a1f55 service neutron] 10.222.0.16 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884633 Sep 03 11:44:47.225138 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-54f32df6-a0c0-4ce5-ba61-d1b1cbb9d5bd req-1c781923-437a-400e-8153-58c25d72acab tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0273869 Sep 03 11:44:48.300510 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ea7b7866-26ab-49b6-9cde-ce47fb66031d req-57ca7d2f-9982-4362-bcba-33a2e29769e1 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0264473 Sep 03 11:44:49.390887 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-26f63600-c3ef-432f-b75b-19ec7bdc8296 req-144c6a6e-0782-468c-813a-634aabbb1782 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0261297 Sep 03 11:44:50.484019 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-8b22c4a2-5858-4e46-9861-84603d8c93d5 req-3a0bcdff-b079-445e-bce6-33807dd545f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0260236 Sep 03 11:44:50.970853 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-3e06f48c-89b5-4e0f-ab70-c9d5d8b7c7a8 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:50.972413 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-3e06f48c-89b5-4e0f-ab70-c9d5d8b7c7a8 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 812 time: 0.1039367 Sep 03 11:44:51.024574 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-7391563b-2b95-41dd-aa45-988ca9409f21 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=278d3bede8a94c32bc0dfdbdfb5259be HTTP/1.1" status: 200 len: 380 time: 0.0339522 Sep 03 11:44:51.034162 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'port': {'device_id': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'admin_state_up': True, 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'security_groups': ['ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb']}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:44:51.220424 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Made reservation on behalf of 278d3bede8a94c32bc0dfdbdfb5259be for: {'port': 1} {{(pid=94433) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 03 11:44:51.226976 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.346613 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_common [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.20.0.14 (c04d12f4-d98f-4e8c-96f9-c0e3c121f28f/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85/0d0b1e27-3589-4edb-ab52-29fc1a756969) {{(pid=94433) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:44:51.480525 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.493470 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Transition to ACTIVE for port object 0d0b1e27-3589-4edb-ab52-29fc1a756969 will not be triggered until provisioned by entity DHCP. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:44:51.578108 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-daeb86ae-69ce-4d0f-8d13-7335f1a34d56 req-9e38fb9a-1aa8-43fc-9b33-ace1fecdb1ab tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0263944 Sep 03 11:44:51.587784 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_create {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.626624 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f is already hosted by enough agents. {{(pid=94433) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:44:51.630677 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.base_scheduler [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94433) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:44:51.634274 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94433) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:44:51.670284 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=1']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:44:51.683674 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.684025 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.684368 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.684703 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.685043 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.685376 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.685706 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.686033 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.686360 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.686711 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.687035 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.687355 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:44:51.710052 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:51.710700 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.815748 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-9fb1e5bf-1125-48d1-9b27-1022e017c209 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7852395 Sep 03 11:44:51.827915 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.v2.base [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Request body: {'port': {'device_id': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-76019'}} {{(pid=94433) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:44:51.880454 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.951730 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-bd52e740-026f-4e76-855a-e98e3d2bb121 None None] Provisioning for port 0d0b1e27-3589-4edb-ab52-29fc1a756969 completed by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:44:51.958451 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-bd52e740-026f-4e76-855a-e98e3d2bb121 None None] Provisioning complete for port 0d0b1e27-3589-4edb-ab52-29fc1a756969 triggered by entity DHCP. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:44:51.958922 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-bd52e740-026f-4e76-855a-e98e3d2bb121 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:51.995518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-bd52e740-026f-4e76-855a-e98e3d2bb121 None None] Port 0d0b1e27-3589-4edb-ab52-29fc1a756969 cannot update to ACTIVE because it is not bound. {{(pid=94434) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Sep 03 11:44:52.145722 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d0b1e27-3589-4edb-ab52-29fc1a756969 {{(pid=94433) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:44:52.152910 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks [] for port, precommit_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:52.165109 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.provisioning_blocks [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Transition to ACTIVE for port object 0d0b1e27-3589-4edb-ab52-29fc1a756969 will not be triggered until provisioned by entity L2. {{(pid=94433) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 03 11:44:52.248830 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:52.301730 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Pushing event updated for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=2']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:44:52.368859 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Attempting to bind port 0d0b1e27-3589-4edb-ab52-29fc1a756969 on host hv-cinder-76019 for vnic_type normal with profile {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 03 11:44:52.369191 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Attempting to bind port 0d0b1e27-3589-4edb-ab52-29fc1a756969 by drivers openvswitch,hyperv on host hv-cinder-76019 at level 0 using segments [{'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 03 11:44:52.369519 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Attempting to bind port 0d0b1e27-3589-4edb-ab52-29fc1a756969 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:44:52.374056 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Port 0d0b1e27-3589-4edb-ab52-29fc1a756969 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-76019 {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Sep 03 11:44:52.374371 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Attempting to bind port 0d0b1e27-3589-4edb-ab52-29fc1a756969 on network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Sep 03 11:44:52.379822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Checking agent: {'id': '637e2ea8-71ad-476c-9d8f-0f0f1d343a85', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-76019', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'started_at': datetime.datetime(2021, 9, 3, 11, 28, 11), 'heartbeat_timestamp': datetime.datetime(2021, 9, 3, 11, 44, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Sep 03 11:44:52.380282 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Checking segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94433) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Sep 03 11:44:52.380525 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Bound using segment: {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'} {{(pid=94433) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Sep 03 11:44:52.380954 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.managers [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Bound port: 0d0b1e27-3589-4edb-ab52-29fc1a756969, host: hv-cinder-76019, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb2f6d21-f66e-4dd1-8720-e92566c40f31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 391, 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f'}}] {{(pid=94433) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 03 11:44:52.381309 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:52.449736 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, cleared binding levels {{(pid=94433) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 03 11:44:52.452801 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 03 11:44:52.541181 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2750996'] for port, after_update {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:52.574044 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:52.574735 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:52.576066 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] 10.222.0.11 "PUT /v2.0/ports/0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 200 len: 1094 time: 0.7523665 Sep 03 11:44:52.576501 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:44:52.578743 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-145ed793-0f30-4df5-8730-0e4f65de979c" -d '{"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:44:52.605921 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0642b73a-442d-4c26-abd7-561b3c2eb66c service neutron] Pushing event updated for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=3']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:44:52.628516 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:44:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2a07a7e-46bb-4e4a-aa03-e0585962f07b x-openstack-request-id: req-c2a07a7e-46bb-4e4a-aa03-e0585962f07b {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:44:52.628857 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:44:52.629284 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-c2a07a7e-46bb-4e4a-aa03-e0585962f07b {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:44:52.629684 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'status': 'completed', 'code': 200} Sep 03 11:44:52.727873 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145ed793-0f30-4df5-8730-0e4f65de979c req-7b3ac86a-a32d-4206-a7f1-edb3c7d28a70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:52.729374 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-145ed793-0f30-4df5-8730-0e4f65de979c req-7b3ac86a-a32d-4206-a7f1-edb3c7d28a70 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1097 time: 0.0789895 Sep 03 11:44:52.741011 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5f3e73-3cc1-493d-bfcb-c18a320aabae req-bd2d0d9a-f265-46d5-8506-9719c2885b50 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:52.742473 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9f5f3e73-3cc1-493d-bfcb-c18a320aabae req-bd2d0d9a-f265-46d5-8506-9719c2885b50 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0830684 Sep 03 11:44:52.829247 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-9f5f3e73-3cc1-493d-bfcb-c18a320aabae req-a00f3368-4c2e-4cc4-b268-d3e4e8385fb9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779617 Sep 03 11:44:52.860169 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145ed793-0f30-4df5-8730-0e4f65de979c req-2a70725b-e884-405f-a014-187b7b228511 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:52.861677 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-145ed793-0f30-4df5-8730-0e4f65de979c req-2a70725b-e884-405f-a014-187b7b228511 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1183553 Sep 03 11:44:52.954479 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145ed793-0f30-4df5-8730-0e4f65de979c req-f1f4ee5a-33f3-413f-81fb-a892c00a5fa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:52.956689 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-145ed793-0f30-4df5-8730-0e4f65de979c req-f1f4ee5a-33f3-413f-81fb-a892c00a5fa3 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0886400 Sep 03 11:44:53.036516 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-e2ee15ad-6652-44fa-9f88-c90cee789d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:53.037980 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-e2ee15ad-6652-44fa-9f88-c90cee789d67 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1097 time: 0.0402796 Sep 03 11:44:53.077737 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-2edc5bda-725d-4a8a-9c2d-ca4c5bf5c0ed service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 200 len: 217 time: 0.0318794 Sep 03 11:44:53.386047 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-a7ed5dfb-4381-40ae-a043-f73c94201c04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:53.387514 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-a7ed5dfb-4381-40ae-a043-f73c94201c04 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.3023887 Sep 03 11:44:53.433226 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0ce1d6f3-6b1d-4576-ae36-361c0cbc2222 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:53.434655 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-0ce1d6f3-6b1d-4576-ae36-361c0cbc2222 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0389094 Sep 03 11:44:53.525079 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-dbcafdd6-2843-423b-b43b-80f07f027790 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830123 Sep 03 11:44:53.613092 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-b1eb945f-9269-4746-9833-e73eb4b2b9bd req-7c3f2705-8ecf-4b19-9e7e-19b2f51a2c0c service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809333 Sep 03 11:44:53.711926 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-3e4e09d9-4400-4d8d-a650-68345957a8fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:53.957325 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6604c5-6524-4bb9-ba3d-7b0e32390d9a req-11ffbeab-7879-4e68-ab01-011f82f1635b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:53.959357 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3c6604c5-6524-4bb9-ba3d-7b0e32390d9a req-11ffbeab-7879-4e68-ab01-011f82f1635b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0517423 Sep 03 11:44:54.002676 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-3c6604c5-6524-4bb9-ba3d-7b0e32390d9a req-7888acf0-83b2-437e-be92-81d6c228ff77 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375185 Sep 03 11:44:55.113999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6498c1-77e3-4483-b2ab-80dc8a756087 req-f52fdaba-331f-4239-b21c-2e21a3f9d35d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:55.115483 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a6498c1-77e3-4483-b2ab-80dc8a756087 req-f52fdaba-331f-4239-b21c-2e21a3f9d35d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0483634 Sep 03 11:44:55.152022 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-0a6498c1-77e3-4483-b2ab-80dc8a756087 req-935e7259-8219-4371-890d-96759cf86448 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304265 Sep 03 11:44:56.264596 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e810764-b3f6-419f-8eda-f8c89ea3bbf5 req-ab89b237-4ed3-4a1f-8c0c-144acd04a962 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:56.266059 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e810764-b3f6-419f-8eda-f8c89ea3bbf5 req-ab89b237-4ed3-4a1f-8c0c-144acd04a962 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0499115 Sep 03 11:44:56.304258 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e810764-b3f6-419f-8eda-f8c89ea3bbf5 req-c9b26ce2-f26d-4966-a28d-63eab2611da2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323076 Sep 03 11:44:56.340531 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-da0b64eb-9458-4f45-89d3-f989339dc9d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:56.711468 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:57.415684 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9a38fe-49ce-406b-9d55-146cbfe21313 req-88803cf0-ae47-4b56-9013-31c1ac74acfb tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:57.417133 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba9a38fe-49ce-406b-9d55-146cbfe21313 req-88803cf0-ae47-4b56-9013-31c1ac74acfb tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0477204 Sep 03 11:44:57.458493 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba9a38fe-49ce-406b-9d55-146cbfe21313 req-b371db8f-8848-45ae-b009-836d25155509 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354924 Sep 03 11:44:57.694368 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:58.570057 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33cd4336-55f4-48ed-9e3f-7b73b56e3b01 req-569087b9-6a06-45b3-aeba-79659ef30aef tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:58.571604 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33cd4336-55f4-48ed-9e3f-7b73b56e3b01 req-569087b9-6a06-45b3-aeba-79659ef30aef tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0496705 Sep 03 11:44:58.609248 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-33cd4336-55f4-48ed-9e3f-7b73b56e3b01 req-248e8552-75b9-4e47-9ed4-a22ae4215477 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316525 Sep 03 11:44:59.123288 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:44:59.722596 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22dd66f9-5c23-45a0-9d16-8b272bc43a11 req-9981e248-9a23-4074-a87c-34797bd3a1e9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:44:59.724066 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-22dd66f9-5c23-45a0-9d16-8b272bc43a11 req-9981e248-9a23-4074-a87c-34797bd3a1e9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0489893 Sep 03 11:44:59.761083 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-22dd66f9-5c23-45a0-9d16-8b272bc43a11 req-9e42d61f-00f2-4559-a97d-6e124aa62a96 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312963 Sep 03 11:45:00.872969 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d209a4e-bdba-4106-95fd-d90ba0b8fae6 req-14aea0c2-cefd-4d00-9f9a-5c05d19c469a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:00.874452 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1d209a4e-bdba-4106-95fd-d90ba0b8fae6 req-14aea0c2-cefd-4d00-9f9a-5c05d19c469a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 944 time: 0.0485785 Sep 03 11:45:00.916088 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1d209a4e-bdba-4106-95fd-d90ba0b8fae6 req-d49661a2-e4a0-4dfd-89d3-0d9a37328367 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0356479 Sep 03 11:45:01.741253 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0d0b1e27-3589-4edb-ab52-29fc1a756969 details requested by agent hyperv_hv-cinder-76019 with host hv-cinder-76019 {{(pid=94434) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 03 11:45:01.836375 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:45:01.847804 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Returning: {'device': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'port_id': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'mac_address': 'fa:16:3e:18:c1:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94434) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 03 11:45:01.888789 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:01.901535 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d0b1e27-3589-4edb-ab52-29fc1a756969 {{(pid=94434) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 03 11:45:01.919982 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:45:01.992060 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:02.032505 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e72b8dc-89d8-4c59-b81d-9525c181477f req-30a3cc2b-ca6d-4d18-a5a5-c1c2d81cbcaa tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:02.033982 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e72b8dc-89d8-4c59-b81d-9525c181477f req-30a3cc2b-ca6d-4d18-a5a5-c1c2d81cbcaa tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 945 time: 0.0495551 Sep 03 11:45:02.040130 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=4']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:45:02.047019 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.047370 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.047704 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.048033 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.048360 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.048684 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.049007 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.049328 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.049650 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.049970 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.051459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.051459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:02.073388 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-7e72b8dc-89d8-4c59-b81d-9525c181477f req-0c9ded62-4742-4103-862b-593726eb2c5f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321410 Sep 03 11:45:02.227458 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] get_ports_and_sgs() called for port_ids ['0d0b1e27-3589-4edb-ab52-29fc1a756969'] {{(pid=94434) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 03 11:45:03.192112 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229754d8-f815-49ab-b71f-267aa2a2852e req-63aff054-1257-4cf0-9e72-711eff3cb91c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:03.193984 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-229754d8-f815-49ab-b71f-267aa2a2852e req-63aff054-1257-4cf0-9e72-711eff3cb91c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 945 time: 0.0489678 Sep 03 11:45:03.230733 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-229754d8-f815-49ab-b71f-267aa2a2852e req-e7cfead8-8be4-438f-b8a7-16b34bf64a5d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308545 Sep 03 11:45:03.756301 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0d0b1e27-3589-4edb-ab52-29fc1a756969 up at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 03 11:45:03.860316 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning for port 0d0b1e27-3589-4edb-ab52-29fc1a756969 completed by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 03 11:45:03.865027 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.provisioning_blocks [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Provisioning complete for port 0d0b1e27-3589-4edb-ab52-29fc1a756969 triggered by entity L2. {{(pid=94434) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 03 11:45:03.872099 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16389963'] for port, provisioning_complete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:03.943768 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:03.965818 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969'}] {{(pid=94434) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:45:03.968076 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9ed6dc78f85eb3a70c69543e6b25957a5f656156c2170fa599b8b0e700737f8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ffc4a4a-e0f6-4572-a4d5-d110650b378f" -d '{"events": [{"server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "name": "network-vif-plugged", "status": "completed", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969"}]}' {{(pid=94434) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:45:03.981215 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:45:04.005290 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:45:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c2111c8-87a9-4d85-850c-ce22a67040b6 x-openstack-request-id: req-9c2111c8-87a9-4d85-850c-ce22a67040b6 {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:45:04.005598 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "name": "network-vif-plugged", "status": "completed", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969", "code": 200}]} {{(pid=94434) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:45:04.005837 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-9c2111c8-87a9-4d85-850c-ce22a67040b6 {{(pid=94434) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:45:04.006227 dv-cinder-760199-12-iscsi neutron-server[94434]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'code': 200} Sep 03 11:45:04.021045 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660'] for port, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:04.068673 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Pushing event updated for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=5']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:45:04.351348 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f8412b1-0f36-41dd-b89b-128d4abc8364 req-278c8ade-699a-4f26-9c36-e6f7ffa9a1c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:04.352739 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f8412b1-0f36-41dd-b89b-128d4abc8364 req-278c8ade-699a-4f26-9c36-e6f7ffa9a1c4 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1099 time: 0.0757537 Sep 03 11:45:04.364624 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3fe46f-4bfe-46ef-b9fa-23f6b046283a req-1369896f-77ca-43d8-a9ed-cb3ae771ea6f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:04.365978 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be3fe46f-4bfe-46ef-b9fa-23f6b046283a req-1369896f-77ca-43d8-a9ed-cb3ae771ea6f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0630867 Sep 03 11:45:04.414908 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1f8412b1-0f36-41dd-b89b-128d4abc8364 req-6165e882-1ec8-417e-87bc-97d3a02ab668 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479515 Sep 03 11:45:04.421692 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-be3fe46f-4bfe-46ef-b9fa-23f6b046283a req-cfb86a02-9c9b-4f9c-a451-f5a7a504453c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489414 Sep 03 11:45:05.538892 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1544a390-ea96-41b1-9065-119250ce8d4c req-d95f103f-352a-4f86-97c5-8bfe2aca6b73 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:05.540439 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1544a390-ea96-41b1-9065-119250ce8d4c req-d95f103f-352a-4f86-97c5-8bfe2aca6b73 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0501804 Sep 03 11:45:05.578884 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-1544a390-ea96-41b1-9065-119250ce8d4c req-1c702aca-95a7-4208-958d-0e6daee619fe tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325449 Sep 03 11:45:06.777484 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-119625ba-a40a-4dfd-9b46-80d3417e6fb7 req-787f1deb-f88f-4c36-bccb-3cf69c6caf9c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:06.778989 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-119625ba-a40a-4dfd-9b46-80d3417e6fb7 req-787f1deb-f88f-4c36-bccb-3cf69c6caf9c tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0516896 Sep 03 11:45:06.817093 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-119625ba-a40a-4dfd-9b46-80d3417e6fb7 req-f7d02ef1-ffa0-426a-a8fd-070d99d23a8d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322587 Sep 03 11:45:06.931315 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4312d594-bf96-4b3b-9554-6940af989898 req-474c1371-b86e-429a-9998-5162d52edf76 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:06.932805 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4312d594-bf96-4b3b-9554-6940af989898 req-474c1371-b86e-429a-9998-5162d52edf76 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0512195 Sep 03 11:45:06.970283 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-4312d594-bf96-4b3b-9554-6940af989898 req-8442ac13-1872-49d3-b6a1-e118e598850b tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316176 Sep 03 11:45:06.993198 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41812) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:45:07.035257 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e1f6be3-610a-4527-b1f5-0ed8fe826874 tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94432) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:07.037367 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-5e1f6be3-610a-4527-b1f5-0ed8fe826874 tempest-TestVolumeBootPattern-793477189 tempest-TestVolumeBootPattern-793477189-project-admin] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1094 time: 0.0431163 Sep 03 11:45:07.040141 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41816) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:45:07.044596 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.v2.base [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Request body: {'floatingip': {'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'port_id': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address': '172.20.0.14'}} {{(pid=94432) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 03 11:45:07.122792 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:07.218219 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:07.323478 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_common [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Allocated IP 172.27.0.68 (e4dc006d-fb22-4cc5-ae28-c350442b2099/70f046b3-3044-4e5c-ab3d-346ae147680d/ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed) {{(pid=94432) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 03 11:45:07.423461 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:07.540358 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8726710240624', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:07.580508 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Network e4dc006d-fb22-4cc5-ae28-c350442b2099 is already hosted by enough agents. {{(pid=94432) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 03 11:45:07.585387 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.base_scheduler [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Resources bound (agent type, host, resource id): {{(pid=94432) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 03 11:45:07.588928 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Received port after_create {{(pid=94432) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 03 11:45:07.596266 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed,revision_number=1']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:45:07.624200 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.624552 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.624898 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.625466 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.625578 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.625884 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.626217 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.626648 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.628291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.628291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.628291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.628291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:45:07.935505 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.061960 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16347139'] for port, before_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.214301 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for port, precommit_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.271654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8726710630602', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8726710240642', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8726710240660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-260545816'] for port, after_update {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.338147 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event updated for resources: {'Port': ['ID=ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed,revision_number=2']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:45:08.349796 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-769335'] for floatingip, after_create {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.454798 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP dcac0603-fae0-4590-bd57-691ecf8d7140 associated. External IP: 172.27.0.68, port: 0d0b1e27-3589-4edb-ab52-29fc1a756969. Sep 03 11:45:08.656076 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:45:08.761410 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:45:08.771115 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:45:08.781180 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:45:08.781802 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:44:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:45:08.854916 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:08.883140 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-ebf2f329-0cbd-42b4-9795-9ab10366941a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8419197 Sep 03 11:45:08.883734 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:45:08.886195 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2f832df-2302-4770-89ed-d8124d188066" -d '{"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:45:08.886740 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:45:08.982799 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:45:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b77ed225-24f9-4669-b907-03b999f8d764 x-openstack-request-id: req-b77ed225-24f9-4669-b907-03b999f8d764 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:45:08.983089 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:45:08.983342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-b77ed225-24f9-4669-b907-03b999f8d764 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:45:08.983741 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'status': 'completed', 'code': 200} Sep 03 11:45:09.046181 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f832df-2302-4770-89ed-d8124d188066 req-3540d2b2-8cd7-4f8b-9015-3b2da1169045 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:09.047611 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-3540d2b2-8cd7-4f8b-9015-3b2da1169045 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1099 time: 0.0400057 Sep 03 11:45:09.123098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}, {'id': 'dcac0603-fae0-4590-bd57-691ecf8d7140', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.68', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:18:c1:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:45:07Z', 'updated_at': '2021-09-03T11:45:07Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:45:09.139734 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f832df-2302-4770-89ed-d8124d188066 req-f4570f3e-cc85-43e9-8828-1a097734c8e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:09.141206 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-f4570f3e-cc85-43e9-8828-1a097734c8e9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0859592 Sep 03 11:45:09.148910 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:45:09.157346 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:45:09.157961 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:44:56Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:45:09.205905 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-55dc08ba-721a-45e7-af8d-3ae15224e42a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 200 len: 999 time: 0.0573432 Sep 03 11:45:09.258533 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f832df-2302-4770-89ed-d8124d188066 req-4abcef69-a593-478f-a95c-fd462419153a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:09.260049 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-4abcef69-a593-478f-a95c-fd462419153a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0478806 Sep 03 11:45:09.265795 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:45:09.308677 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2f832df-2302-4770-89ed-d8124d188066 req-c8a2c97f-5e1d-4641-8fd1-043fe3a8f4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:09.310135 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-c8a2c97f-5e1d-4641-8fd1-043fe3a8f4a7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0433555 Sep 03 11:45:09.399527 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-722f33e5-4aec-496e-9ee7-1739b4f4b758 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816772 Sep 03 11:45:09.493231 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-a2f832df-2302-4770-89ed-d8124d188066 req-94f1c24f-7148-4e2c-8009-b65a489229bd service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868740 Sep 03 11:45:09.503278 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}, {'id': 'dcac0603-fae0-4590-bd57-691ecf8d7140', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.68', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:18:c1:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:45:07Z', 'updated_at': '2021-09-03T11:45:07Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:45:09.529450 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c2c098-f8b7-4197-a4f1-7ae120706866 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}, {'id': 'dcac0603-fae0-4590-bd57-691ecf8d7140', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.68', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:18:c1:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:45:07Z', 'updated_at': '2021-09-03T11:45:07Z', 'revision_number': 0, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:45:09.709666 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69a6e5a9-b920-4f76-a0c1-3d9c444ff062 None None] New status for floating IP dcac0603-fae0-4590-bd57-691ecf8d7140: ACTIVE {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:45:13.888410 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:15.524319 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-cbfbf6af-c78a-409f-969a-b76d0254f6e1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0803001 Sep 03 11:45:15.606620 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-d2e65ccd-da08-4d33-a95c-cd171f7cc697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:15.608060 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-d2e65ccd-da08-4d33-a95c-cd171f7cc697 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0425849 Sep 03 11:45:15.707175 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-bdca01a6-e63f-473e-8128-ea412f8f994f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:15.708539 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-bdca01a6-e63f-473e-8128-ea412f8f994f service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0819299 Sep 03 11:45:15.774956 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-f09118db-ef15-43bb-8096-c15e912e7dfc service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 1001 time: 0.0595930 Sep 03 11:45:15.822713 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-20321a2a-4429-4631-80ce-8d4e1e2b2ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:15.824111 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-20321a2a-4429-4631-80ce-8d4e1e2b2ef4 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0419524 Sep 03 11:45:15.869069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-c8a22860-b049-4f03-97b3-22706fed215e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:45:15.870552 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-c8a22860-b049-4f03-97b3-22706fed215e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0387905 Sep 03 11:45:15.961556 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-71961186-eea5-442a-b118-c5c2efa90b2e service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833943 Sep 03 11:45:16.047761 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-83b87592-dafa-4b9c-b6a1-8b22ed6f44f6 req-556b827b-0f12-4145-8fae-1adc7622294e service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787413 Sep 03 11:45:16.939444 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:45:23.682493 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2604143d-cc4f-4ac1-b997-49d96171537f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:26.351145 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-660af2c9-6d81-4540-a65b-04f815c57c2b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:26.705193 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:27.682257 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:29.094159 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:43.934082 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:53.670621 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-84b93fbf-8b94-4403-872b-075a6d668486 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:53.937929 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:45:56.351464 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-020823fe-5f4c-498c-aa24-61982dceea48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:56.721737 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:57.693115 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:45:59.116878 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:13.938636 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:16.542175 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-13d7ece8-ee72-49df-9309-87f978abf4af service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0439060 Sep 03 11:46:16.600916 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-2239c026-3ebc-4007-9c08-c122e5f5c894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:16.602348 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-2239c026-3ebc-4007-9c08-c122e5f5c894 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1099 time: 0.0399477 Sep 03 11:46:16.702045 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-9a735755-070f-4dab-9c0a-b853c2679cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:16.703554 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-9a735755-070f-4dab-9c0a-b853c2679cd6 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0812016 Sep 03 11:46:16.768997 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-8e8da850-e9e9-4ea3-80a3-6294c90dfd8d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 200 len: 1001 time: 0.0583029 Sep 03 11:46:16.818362 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-8ec3c2f8-b061-47ed-a0ce-634bbaed4003 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:16.819717 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-8ec3c2f8-b061-47ed-a0ce-634bbaed4003 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0440266 Sep 03 11:46:16.864335 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-3079069d-ab16-480d-b50c-6032df6b23e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:16.865839 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-3079069d-ab16-480d-b50c-6032df6b23e9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0392120 Sep 03 11:46:16.956348 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-99bb6d80-2226-4434-8763-abec1b68a026 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828576 Sep 03 11:46:17.044485 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-2e2983f1-181c-415b-a9ac-e7409d801a63 req-8d001261-20b5-438f-8a80-ae3fde3f667a service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0792804 Sep 03 11:46:23.675815 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-132e99dd-2e58-4f4c-9d42-b3a8c38b3b99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:26.344156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7af3d5ca-6d05-4fbe-8247-55cf75586c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:26.715868 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:27.704243 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:29.127184 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:30.936888 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:46:35.945721 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41848) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:36.099296 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:36.099655 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:36.174345 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:36.174693 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:36.186724 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed owned by network:floatingip {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:36.372806 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:36.400540 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=ccc4eb7c-65a3-4e9c-91ed-002e4a4cbbed,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:36.413747 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.414119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.414654 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.415191 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.415761 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.416342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.416915 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.417460 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.418046 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.418660 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.419210 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.419729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94432) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:36.476847 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:36.477096 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP dcac0603-fae0-4590-bd57-691ecf8d7140 disassociated (deleted). External IP: 172.27.0.68, port: 0d0b1e27-3589-4edb-ab52-29fc1a756969. Sep 03 11:46:36.938305 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:46:36.981543 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [req-1649b663-fdef-4941-b623-c0935f018f23 req-cbd35b61-5c0a-4ae2-b74a-bff5932e246d service neutron] (94432) timed out ('10.222.0.11', 57476) {{(pid=94432) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 03 11:46:37.045917 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:46:37.050986 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:37.055943 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:46:37.065251 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:37.065863 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:37.080147 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-5949df67-6959-43df-b898-34e1b87709f2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "DELETE /v2.0/floatingips/dcac0603-fae0-4590-bd57-691ecf8d7140 HTTP/1.1" status: 204 len: 168 time: 1.1333547 Sep 03 11:46:37.080730 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:46:37.083542 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-150c152c-989d-4cb6-96f7-0c115ad1df77" -d '{"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:46:37.121622 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:46:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3e550e4-13ee-49e3-8919-8d6f939db9f7 x-openstack-request-id: req-a3e550e4-13ee-49e3-8919-8d6f939db9f7 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:46:37.121914 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:46:37.122543 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-a3e550e4-13ee-49e3-8919-8d6f939db9f7 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:46:37.122983 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'status': 'completed', 'code': 200} Sep 03 11:46:37.175022 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:37.189848 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-6c07d350-4271-47ec-bdc8-05b321967bca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:37.191974 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-6c07d350-4271-47ec-bdc8-05b321967bca service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 1099 time: 0.0454845 Sep 03 11:46:37.284664 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-d8c6f629-5475-46b6-8f2c-366fd832b7f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:37.286447 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-d8c6f629-5475-46b6-8f2c-366fd832b7f9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0880220 Sep 03 11:46:37.333809 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-8d6af546-1283-4539-bcf5-3a3c26acf051 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 200 len: 217 time: 0.0396914 Sep 03 11:46:37.385292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-9e135930-4304-417b-944b-74bb7c2eb1d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:37.385292 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-9e135930-4304-417b-944b-74bb7c2eb1d7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0445642 Sep 03 11:46:37.409305 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:37.440762 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:46:37.443745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-d22238c7-a8fc-41eb-b01a-c12ead12a7da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:37.445296 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-d22238c7-a8fc-41eb-b01a-c12ead12a7da service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0536849 Sep 03 11:46:37.449544 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:37.450156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:37.555702 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:37.577606 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e202ea40-f2bc-4862-8e75-ccb8c65387c6 req-6198530a-0814-4350-a7f3-7abf5d1b443a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:37.579126 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e202ea40-f2bc-4862-8e75-ccb8c65387c6 req-6198530a-0814-4350-a7f3-7abf5d1b443a tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.1430650 Sep 03 11:46:37.580862 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-8d4244dc-f72b-46d7-bfd4-0c70cb009449 service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277046 Sep 03 11:46:37.646788 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e202ea40-f2bc-4862-8e75-ccb8c65387c6 req-6663cc78-4412-4964-b0fd-2e1c5b0c5fd7 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606444 Sep 03 11:46:37.702047 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-150c152c-989d-4cb6-96f7-0c115ad1df77 req-526aef5d-c39b-4d7d-8d1e-7fd02dc2cf2c service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1088924 Sep 03 11:46:37.782169 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:37.808832 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-165bf278-fa3e-4ca3-aa74-18e30349f068 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_floatingips': [{'id': 'b6a67955-e743-4ef0-a0ee-cec0b5928d58', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'floating_ip_address': '172.27.0.230', 'floating_network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'router_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'port_id': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'mac_address': 'fa:16:3e:3b:32:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-03T11:43:09Z', 'updated_at': '2021-09-03T11:43:11Z', 'revision_number': 1, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:46:38.014710 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6678ee27-2b00-4a60-bcba-cf0514574726 None None] New status for floating IP dcac0603-fae0-4590-bd57-691ecf8d7140: DOWN {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:46:38.812353 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba1a68cf-0725-4bf7-bbef-9dac1fbabdb6 req-ebcda9e5-c053-43b3-bc5a-cf2e4a6a74cc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:38.813823 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba1a68cf-0725-4bf7-bbef-9dac1fbabdb6 req-ebcda9e5-c053-43b3-bc5a-cf2e4a6a74cc tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0977254 Sep 03 11:46:38.850845 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ba1a68cf-0725-4bf7-bbef-9dac1fbabdb6 req-eee79cbb-a772-483c-a024-a4014cc7d3b3 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306952 Sep 03 11:46:38.961778 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-60fbde83-1d8a-4313-8a5a-2a4f4915064f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:38.963144 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-60fbde83-1d8a-4313-8a5a-2a4f4915064f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 946 time: 0.0474904 Sep 03 11:46:39.053052 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port 0d0b1e27-3589-4edb-ab52-29fc1a756969 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:39.053382 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:39.137670 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] For port 0d0b1e27-3589-4edb-ab52-29fc1a756969, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=0d0b1e27-3589-4edb-ab52-29fc1a756969,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:39.138023 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:39.150568 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for 0d0b1e27-3589-4edb-ab52-29fc1a756969 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:39.315838 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:39.347567 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=0d0b1e27-3589-4edb-ab52-29fc1a756969,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:39.373080 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.373809 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.373809 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.374062 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.374460 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.374742 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.375063 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.375383 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.375708 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.376025 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.376340 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.376652 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94433) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:39.399327 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] No DVR routers for this DVR port 0d0b1e27-3589-4edb-ab52-29fc1a756969 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:39.402532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:39.403787 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-703a6fe1-579a-4280-93ee-1ea0a1fb389b req-15068460-2d98-4b18-998e-38c4fe858a91 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "DELETE /v2.0/ports/0d0b1e27-3589-4edb-ab52-29fc1a756969 HTTP/1.1" status: 204 len: 173 time: 0.4349310 Sep 03 11:46:39.404228 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'name': 'network-vif-deleted', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:46:39.406467 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-562ccc40-b367-4184-b60e-cf90279b34df" -d '{"events": [{"server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "name": "network-vif-deleted", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:46:39.456176 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:46:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-317aed5e-7d25-43b4-92de-8fd6d22cc705 x-openstack-request-id: req-317aed5e-7d25-43b4-92de-8fd6d22cc705 {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:46:39.456465 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b188cbe9-65b8-414a-b4be-0746cf189138", "name": "network-vif-deleted", "tag": "0d0b1e27-3589-4edb-ab52-29fc1a756969", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:46:39.456715 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-317aed5e-7d25-43b4-92de-8fd6d22cc705 {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:46:39.457107 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b188cbe9-65b8-414a-b4be-0746cf189138', 'name': 'network-vif-deleted', 'tag': '0d0b1e27-3589-4edb-ab52-29fc1a756969', 'status': 'completed', 'code': 200} Sep 03 11:46:39.945111 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ce1093f2-c5ec-4cd6-be61-5ea10c4666f1 req-5577ddba-3426-413a-9334-a5f551fcd6be tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=b188cbe9-65b8-414a-b4be-0746cf189138 HTTP/1.1" status: 200 len: 210 time: 0.0273778 Sep 03 11:46:43.414629 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41894) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:43.573424 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port 10bfed72-c466-436e-9566-ba577d50ec12 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:43.573729 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.652837 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.653155 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.665056 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for 10bfed72-c466-436e-9566-ba577d50ec12 owned by network:floatingip {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:43.881426 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.911330 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=10bfed72-c466-436e-9566-ba577d50ec12,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:43.927156 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.976405 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:43.976766 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.db.l3_db [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Floating IP b6a67955-e743-4ef0-a0ee-cec0b5928d58 disassociated (deleted). External IP: 172.27.0.230, port: 1bf88c07-cb79-47fb-b90c-89309f3eff39. Sep 03 11:46:44.199694 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:46:44.262199 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0d0b1e27-3589-4edb-ab52-29fc1a756969 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:44.285459 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 0d0b1e27-3589-4edb-ab52-29fc1a756969 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:44.285926 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 0d0b1e27-3589-4edb-ab52-29fc1a756969 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:44.310010 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:46:44.314434 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:44.324474 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:46:44.333537 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:44.334138 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:44.341652 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-36c0a1b2-6292-47f8-9dfe-b2e294ac73b9 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "DELETE /v2.0/floatingips/b6a67955-e743-4ef0-a0ee-cec0b5928d58 HTTP/1.1" status: 204 len: 168 time: 0.9259520 Sep 03 11:46:44.342342 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39'}] {{(pid=94432) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:46:44.344745 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cf26483ebbd1e77bed562252446362919e216e47930fdac759653a753e012d71" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6" -d '{"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39"}]}' {{(pid=94432) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:46:44.393272 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 03 Sep 2021 11:46:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5428651d-99f0-4d7d-8178-53ee14c0b4f9 x-openstack-request-id: req-5428651d-99f0-4d7d-8178-53ee14c0b4f9 {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:46:44.393651 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39", "status": "completed", "code": 200}]} {{(pid=94432) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:46:44.393839 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-5428651d-99f0-4d7d-8178-53ee14c0b4f9 {{(pid=94432) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:46:44.394221 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'status': 'completed', 'code': 200} Sep 03 11:46:44.454774 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-8f94cbe9-fc3d-4271-8645-f43d81b2039b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:44.456191 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-8f94cbe9-fc3d-4271-8645-f43d81b2039b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 1098 time: 0.0432982 Sep 03 11:46:44.550690 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-7ef3b990-b78c-4165-a678-9d167a3ce33c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:44.553030 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-7ef3b990-b78c-4165-a678-9d167a3ce33c service neutron] 10.222.0.11 "GET /v2.0/networks?id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 200 len: 913 time: 0.0897148 Sep 03 11:46:44.579546 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:44.600965 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-ce9af269-b780-4805-8c4b-19a683f46922 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 200 len: 217 time: 0.0357773 Sep 03 11:46:44.657044 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-8dc1a60c-fd88-4583-94d8-6802a8c46ae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:44.658601 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-8dc1a60c-fd88-4583-94d8-6802a8c46ae6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 200 len: 851 time: 0.0508821 Sep 03 11:46:44.737422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-c1f58b22-daf0-4947-9a94-f28570b7ff84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:44.738899 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-c1f58b22-daf0-4947-9a94-f28570b7ff84 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0718584 Sep 03 11:46:44.751847 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751ae62-8e67-4291-b5ec-d8bf47923765 req-fd9f57b2-c34f-4aef-8756-18fece8616c2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:44.753336 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e751ae62-8e67-4291-b5ec-d8bf47923765 req-fd9f57b2-c34f-4aef-8756-18fece8616c2 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0784566 Sep 03 11:46:44.793147 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:44.819790 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:46:44.828003 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:44.828615 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:44.841308 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-e751ae62-8e67-4291-b5ec-d8bf47923765 req-7ea1a1e6-8c82-4103-a047-369a1d9c6011 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0793161 Sep 03 11:46:44.868098 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-f1993877-b0a1-4fe0-be0c-a4081f69ad7f service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1137774 Sep 03 11:46:44.944709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:44.966563 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-24cdedc8-0bbb-4b67-9477-4a8d9ede8aa6 req-33c8d087-e8a4-4648-92f4-b4f8e8933adf service neutron] 10.222.0.11 "GET /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910821 Sep 03 11:46:45.144733 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:45.170043 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5869e8-6dcf-4431-9786-252bd7db6419 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:39:58Z', 'revision_number': 4, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi', '_interfaces': [{'id': '67ccc434-da7d-40a4-b364-63d4ca615862', 'name': '', 'network_id': 'c04d12f4-d98f-4e8c-96f9-c0e3c121f28f', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'mac_address': 'fa:16:3e:49:86:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 607, 'fixed_ips': [{'subnet_id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:58Z', 'updated_at': '2021-09-03T11:40:03Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'subnets': [{'id': 'c2cc5f0a-a78a-4143-a2c2-d233faf2cc85', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:46:45.377227 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-697d22a1-4cb4-4b9f-9089-0d3ce8d57413 None None] New status for floating IP b6a67955-e743-4ef0-a0ee-cec0b5928d58: DOWN {{(pid=94435) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 03 11:46:45.958726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727ade4-4c34-49df-bf10-975a0cdf8c45 req-ab279844-e042-42a2-8bee-bc455ea94550 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:45.960207 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5727ade4-4c34-49df-bf10-975a0cdf8c45 req-ab279844-e042-42a2-8bee-bc455ea94550 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0499501 Sep 03 11:46:45.997453 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-5727ade4-4c34-49df-bf10-975a0cdf8c45 req-af92a795-acae-455b-8451-f640343f2342 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/security-groups?id=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313818 Sep 03 11:46:46.137966 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25489c25-8da2-48bf-bbd0-67dd2c14895e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94433) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 03 11:46:46.139315 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25489c25-8da2-48bf-bbd0-67dd2c14895e tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 945 time: 0.0500052 Sep 03 11:46:46.226682 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port 1bf88c07-cb79-47fb-b90c-89309f3eff39 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:46.227015 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:46.317657 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] For port 1bf88c07-cb79-47fb-b90c-89309f3eff39, host hv-cinder-76019, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-76019',level=0,port_id=1bf88c07-cb79-47fb-b90c-89309f3eff39,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:46.318002 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:46.329251 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for 1bf88c07-cb79-47fb-b90c-89309f3eff39 owned by compute:nova {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:46.498313 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:46.531177 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=1bf88c07-cb79-47fb-b90c-89309f3eff39,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:46.569988 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] No DVR routers for this DVR port 1bf88c07-cb79-47fb-b90c-89309f3eff39 on host hv-cinder-76019 {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:46.572532 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for port, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:46.574503 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-ca9e4456-82f7-4ce1-8e1c-286586b407b5 req-25992a91-4d5b-46cd-80d8-340f0e7ae67f tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.11 "DELETE /v2.0/ports/1bf88c07-cb79-47fb-b90c-89309f3eff39 HTTP/1.1" status: 204 len: 173 time: 0.4290345 Sep 03 11:46:46.574985 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'name': 'network-vif-deleted', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39'}] {{(pid=94433) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 03 11:46:46.577174 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.16/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}45a78e6b64077090c65b104253d2d24b053e2733b04a3c1533c5860a9f3910c8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27635673-6085-49d0-9f5e-84d777286790" -d '{"events": [{"server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "name": "network-vif-deleted", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39"}]}' {{(pid=94433) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 03 11:46:46.614209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 03 Sep 2021 11:46:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e57a4771-9c74-46c4-9134-ef6a5891e49f x-openstack-request-id: req-e57a4771-9c74-46c4-9134-ef6a5891e49f {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 03 11:46:46.614209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "369cf50a-a455-4118-bafa-480cfe05d5ba", "name": "network-vif-deleted", "tag": "1bf88c07-cb79-47fb-b90c-89309f3eff39", "status": "completed", "code": 200}]} {{(pid=94433) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 03 11:46:46.614209 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.16/compute/v2.1/os-server-external-events used request id req-e57a4771-9c74-46c4-9134-ef6a5891e49f {{(pid=94433) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 03 11:46:46.614579 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '369cf50a-a455-4118-bafa-480cfe05d5ba', 'name': 'network-vif-deleted', 'tag': '1bf88c07-cb79-47fb-b90c-89309f3eff39', 'status': 'completed', 'code': 200} Sep 03 11:46:47.090541 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [req-f877d3f1-a746-4ed4-8ea7-e1f2d890c020 req-d610d2ac-d1ad-478a-8896-7bc11913bfe0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "GET /v2.0/ports?device_id=369cf50a-a455-4118-bafa-480cfe05d5ba HTTP/1.1" status: 200 len: 210 time: 0.0268390 Sep 03 11:46:48.146922 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41910) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:48.267046 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Deleting port 78b0414c-8e44-42e6-81ac-728b5cf2e0d5 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:48.267387 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.343461 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.343786 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.355905 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Calling delete_port for 78b0414c-8e44-42e6-81ac-728b5cf2e0d5 owned by network:floatingip {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:48.538330 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.564004 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'Port': ['ID=78b0414c-8e44-42e6-81ac-728b5cf2e0d5,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:48.623638 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for floatingip, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.626038 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-15040'] for floatingip, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:48.627207 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-6f710aaa-dc5a-4a1b-ac74-42bbc52364e0 tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "DELETE /v2.0/floatingips/adcd290d-92d4-4506-82f6-bb4dab7f5eb6 HTTP/1.1" status: 204 len: 168 time: 0.4793038 Sep 03 11:46:49.948215 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41924) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:50.005512 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:50.029615 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:50.172640 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:50.175245 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:50.176465 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] 10.222.0.16 "DELETE /v2.0/security-groups/ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb HTTP/1.1" status: 204 len: 168 time: 0.2272036 Sep 03 11:46:50.186138 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e89ce9d-a99b-4083-9bf4-6708f7fc173d tempest-TestVolumeBootPattern-875993953 tempest-TestVolumeBootPattern-875993953-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab1790c7-3e94-4a78-be8c-9c0a5b4ab1eb,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:50.311180 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1bf88c07-cb79-47fb-b90c-89309f3eff39 no longer exists at agent hyperv_hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:50.315548 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41930) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:50.336796 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] No Port match for: 1bf88c07-cb79-47fb-b90c-89309f3eff39 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:50.337007 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Device 1bf88c07-cb79-47fb-b90c-89309f3eff39 not bound to the agent host hv-cinder-76019 {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:51.026999 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:51.259604 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Deleting port 67ccc434-da7d-40a4-b364-63d4ca615862 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:51.259940 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:51.334822 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] For port 67ccc434-da7d-40a4-b364-63d4ca615862, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=67ccc434-da7d-40a4-b364-63d4ca615862,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:51.335094 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:51.351689 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Calling delete_port for 67ccc434-da7d-40a4-b364-63d4ca615862 owned by network:router_interface {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:51.561465 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:51.588450 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Pushing event deleted for resources: {'Port': ['ID=67ccc434-da7d-40a4-b364-63d4ca615862,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:51.745422 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:51.949727 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94433) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:46:52.054328 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94433) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:46:52.059552 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-e848fcb1-2568-4061-a24b-4cbe294ef333 admin admin] 10.222.0.16 "PUT /v2.0/routers/ed1cd22b-8bf9-4de7-bd34-b67e13527e9b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7428620 Sep 03 11:46:52.062198 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41934) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:52.063554 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Sync routers for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:46:52.073329 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:52.073938 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:52.162093 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks [] for router, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.175929 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: dv-cinder-760199-12-iscsi {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:52.263814 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.355505 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162'}], 'enable_snat': True}, 'gw_port_id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:46:51Z', 'revision_number': 5, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port': {'id': 'e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:42:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 606, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:39:56Z', 'updated_at': '2021-09-03T11:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:52.381725 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Deleting port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:52.382069 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.390524 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Checking router: ed1cd22b-8bf9-4de7-bd34-b67e13527e9b for host: dv-cinder-760199-12-iscsi {{(pid=94434) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:46:52.399682 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Routers {'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94434) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:52.400289 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'], 'active': True} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:52.463995 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] For port e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:52.464356 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.477140 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Calling delete_port for e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 owned by network:router_gateway {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:52.490485 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvr_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] Set router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b gateway port host: None {{(pid=94434) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:52.540909 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_hamode_db [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:46:52Z', 'revision_number': 6, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94434) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:52.569288 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-342aae30-f866-4a7e-94cd-98696d25a7b5 None None] The sync data for ids ['ed1cd22b-8bf9-4de7-bd34-b67e13527e9b'] in dv-cinder-760199-12-iscsi is: [{'id': 'ed1cd22b-8bf9-4de7-bd34-b67e13527e9b', 'name': 'tempest-TestVolumeBootPattern-1826526440-router', 'tenant_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:39:55Z', 'updated_at': '2021-09-03T11:46:52Z', 'revision_number': 6, 'project_id': '278d3bede8a94c32bc0dfdbdfb5259be', 'gw_port_host': None}] {{(pid=94434) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:46:52.686845 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.715726 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Pushing event deleted for resources: {'Port': ['ID=e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:52.773607 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.860216 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.862151 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.950052 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.950622 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ed1cd22b-8bf9-4de7-bd34-b67e13527e9b {{(pid=94433) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:46:52.957211 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] Notify callbacks [] for router, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:52.957211 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-c2989e2d-938b-4694-81e0-b4b27c4100b9 admin admin] 10.222.0.16 "DELETE /v2.0/routers/ed1cd22b-8bf9-4de7-bd34-b67e13527e9b HTTP/1.1" status: 204 len: 168 time: 0.8930314 Sep 03 11:46:52.959560 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41938) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:53.008101 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Deleting subnet c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 {{(pid=94433) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:46:53.011155 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.045324 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3381773'] for subnet, precommit_delete_associations {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.123760 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.235876 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2751022', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3234373'] for subnet, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.259806 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c2cc5f0a-a78a-4143-a2c2-d233faf2cc85,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:53.265243 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for subnet, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.267251 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-b0c40545-b8b6-4b0c-be81-3e673c76ac8e admin admin] 10.222.0.16 "DELETE /v2.0/subnets/c2cc5f0a-a78a-4143-a2c2-d233faf2cc85 HTTP/1.1" status: 204 len: 168 time: 0.3066015 Sep 03 11:46:53.270560 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41940) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:53.272033 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee825ce8-8110-42c5-8bda-ecf5dd81cf44 None None] Network c04d12f4-d98f-4e8c-96f9-c0e3c121f28f requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:46:53.343949 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.391852 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:53.402760 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Deleting port 12d32079-0aff-49d8-9ab9-e53cdc208278 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:53.403153 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.413978 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:53.414330 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device e44be4fe-ff91-437b-bfc3-69ed8a0ad1a1 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:53.414775 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 67ccc434-da7d-40a4-b364-63d4ca615862 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:53.437218 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 67ccc434-da7d-40a4-b364-63d4ca615862 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:53.437457 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 67ccc434-da7d-40a4-b364-63d4ca615862 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:53.473942 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] For port 12d32079-0aff-49d8-9ab9-e53cdc208278, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=12d32079-0aff-49d8-9ab9-e53cdc208278,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:53.473942 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.485521 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Calling delete_port for 12d32079-0aff-49d8-9ab9-e53cdc208278 owned by network:dhcp {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:53.523713 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] DHCP port deletion for c04d12f4-d98f-4e8c-96f9-c0e3c121f28f request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:46:53.580224 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Deleting port 12d32079-0aff-49d8-9ab9-e53cdc208278 {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:53.580224 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.618421 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.649346 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Pushing event deleted for resources: {'Port': ['ID=12d32079-0aff-49d8-9ab9-e53cdc208278,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:53.651830 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] No DVR routers for this DVR port 12d32079-0aff-49d8-9ab9-e53cdc208278 on host dv-cinder-760199-12-iscsi {{(pid=94432) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:53.654573 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] For port 12d32079-0aff-49d8-9ab9-e53cdc208278, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=12d32079-0aff-49d8-9ab9-e53cdc208278,segment=NetworkSegment(fb2f6d21-f66e-4dd1-8720-e92566c40f31),segment_id=fb2f6d21-f66e-4dd1-8720-e92566c40f31)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:53.654971 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.668098 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Calling delete_port for 12d32079-0aff-49d8-9ab9-e53cdc208278 owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:53.709715 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-25d01b92-a9db-4091-aa46-10418f5dfef2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.727337 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.737501 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c04d12f4-d98f-4e8c-96f9-c0e3c121f28f']}} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:53.744142 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.747849 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb2f6d21-f66e-4dd1-8720-e92566c40f31') {'for_net_delete': True} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:53.748160 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.services.segments.db [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb2f6d21-f66e-4dd1-8720-e92566c40f31') {} {{(pid=94432) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:53.757500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3053428'] for segment, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.771591 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.772082 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Pushing event deleted for resources: {'Port': ['ID=12d32079-0aff-49d8-9ab9-e53cdc208278,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:53.778103 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Releasing vlan 391 on physical network physnet1 to pool {{(pid=94432) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:46:53.778517 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-260545916'] for segment, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.779750 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] No DVR routers for this DVR port 12d32079-0aff-49d8-9ab9-e53cdc208278 on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: Traceback (most recent call last): Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: timer() Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: cb(*args, **kw) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: return func(*args, **kwargs) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: self._notify() Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: self.callback(batched_events) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: event.method(event) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: return f(self, *a, **k) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._get(url).json() Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: return self.request(url, 'GET', **kwargs) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:46:53.780178 dv-cinder-760199-12-iscsi neutron-server[94432]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.787897 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8662f88a-18fe-4a88-a0ef-2fd52fe8ebc9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-760199-12-iscsi {{(pid=94434) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 03 11:46:53.903777 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.909260 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:53.913414 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] 10.222.0.16 "DELETE /v2.0/networks/c04d12f4-d98f-4e8c-96f9-c0e3c121f28f HTTP/1.1" status: 204 len: 168 time: 0.6398973 Sep 03 11:46:53.920543 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41942) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:53.929631 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06f5f5c-c30d-428f-8f90-72421c86d92d admin admin] Pushing event deleted for resources: {'Network': ['ID=c04d12f4-d98f-4e8c-96f9-c0e3c121f28f,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:54.269422 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-784951'] for router_interface, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:54.538961 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Deleting port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:54.539611 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:54.615941 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] For port 334d1c00-e0fa-457d-97d7-0bce0cd90b7d, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:54.616306 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:54.628435 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Calling delete_port for 334d1c00-e0fa-457d-97d7-0bce0cd90b7d owned by network:router_interface {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:54.869504 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:54.896500 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Pushing event deleted for resources: {'Port': ['ID=334d1c00-e0fa-457d-97d7-0bce0cd90b7d,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:55.071170 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-530347', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785059'] for router_interface, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:55.334064 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 12d32079-0aff-49d8-9ab9-e53cdc208278 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:55.354065 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 12d32079-0aff-49d8-9ab9-e53cdc208278 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:55.354427 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 12d32079-0aff-49d8-9ab9-e53cdc208278 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:55.540046 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 has already been hosted by L3 agent dbefb229-5c0f-4788-9c55-3b23d42e0d2c {{(pid=94432) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 03 11:46:55.644583 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] Notify agent at l3_agent.dv-cinder-760199-12-iscsi the message routers_updated {{(pid=94432) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 03 11:46:55.649654 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-c645863d-d392-415e-a752-61cac9e13638 admin admin] 10.222.0.16 "PUT /v2.0/routers/d4f05a8c-f0cc-44d3-a23a-b67f4987aa83/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7342641 Sep 03 11:46:55.652167 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41944) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:55.654592 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Sync routers for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 03 11:46:55.664499 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:55.665102 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:55.758109 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks [] for router, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:55.765753 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: dv-cinder-760199-12-iscsi {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:55.861953 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:55.940740 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'external_fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34'}], 'enable_snat': True}, 'gw_port_id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:46:54Z', 'revision_number': 5, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port': {'id': '233c179b-0751-4151-a8dc-dae98a9614f4', 'name': '', 'network_id': 'e4dc006d-fb22-4cc5-ae28-c350442b2099', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:4b:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'device_owner': 'network:router_gateway', 'standard_attr_id': 618, 'fixed_ips': [{'subnet_id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'ip_address': '172.27.0.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-760199-12-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-03T11:40:02Z', 'updated_at': '2021-09-03T11:40:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '70f046b3-3044-4e5c-ab3d-346ae147680d', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-760199-12-iscsi'}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:55.969621 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Checking router: d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 for host: dv-cinder-760199-12-iscsi {{(pid=94435) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 03 11:46:55.975389 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Deleting port 233c179b-0751-4151-a8dc-dae98a9614f4 {{(pid=94432) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:55.975795 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:55.978871 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Routers {'d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'} bound to L3 agent in host dv-cinder-760199-12-iscsi {{(pid=94435) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 03 11:46:55.979483 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-760199-12-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-03T11:21:56Z,description=,heartbeat_timestamp=2021-09-03T11:46:26Z,host='dv-cinder-760199-12-iscsi',id=dbefb229-5c0f-4788-9c55-3b23d42e0d2c,load=0,resource_versions=,resources_synced=,started_at=2021-09-03T11:21:57Z,topic='l3_agent')) {'router_ids': ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'], 'active': True} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:56.057509 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.db [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] For port 233c179b-0751-4151-a8dc-dae98a9614f4, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=233c179b-0751-4151-a8dc-dae98a9614f4,segment=NetworkSegment(18788aa0-7c42-4414-898c-7e3c618cd0d7),segment_id=18788aa0-7c42-4414-898c-7e3c618cd0d7)] {{(pid=94432) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:56.057870 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.063904 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_dvr_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] Set router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 gateway port host: None {{(pid=94435) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 03 11:46:56.070759 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.plugins.ml2.plugin [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Calling delete_port for 233c179b-0751-4151-a8dc-dae98a9614f4 owned by network:router_gateway {{(pid=94432) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:56.114178 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.l3_hamode_db [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:46:55Z', 'revision_number': 6, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port_host': None}], 'dv-cinder-760199-12-iscsi', False) {} {{(pid=94435) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:56.142426 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5537b407-d8d4-480d-b1db-32153c656c49 None None] The sync data for ids ['d4f05a8c-f0cc-44d3-a23a-b67f4987aa83'] in dv-cinder-760199-12-iscsi is: [{'id': 'd4f05a8c-f0cc-44d3-a23a-b67f4987aa83', 'name': 'tempest-TestVolumeBootPattern-742933716-router', 'tenant_id': '60a05a95d23447fe8439542f0d2906db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-03T11:40:01Z', 'updated_at': '2021-09-03T11:46:55Z', 'revision_number': 6, 'project_id': '60a05a95d23447fe8439542f0d2906db', 'gw_port_host': None}] {{(pid=94435) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 03 11:46:56.298334 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-260545807'] for port, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.331128 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Pushing event deleted for resources: {'Port': ['ID=233c179b-0751-4151-a8dc-dae98a9614f4,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:56.360797 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-35266147-f704-4b55-9866-baac5df38288 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.391913 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-783565'] for router_gateway, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.486194 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-757010', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-11869'] for router, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.489119 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.618679 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-757099'] for router, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.619220 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Fanout notify agent at l3_agent the message router_deleted on router d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 {{(pid=94432) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 03 11:46:56.623628 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] Notify callbacks [] for router, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.624771 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-cd44ed68-b476-49a2-b412-3f52f96d482c admin admin] 10.222.0.16 "DELETE /v2.0/routers/d4f05a8c-f0cc-44d3-a23a-b67f4987aa83 HTTP/1.1" status: 204 len: 168 time: 0.9716787 Sep 03 11:46:56.627238 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [-] (94432) accepted ('10.222.0.16', 41948) {{(pid=94432) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:56.674291 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Deleting subnet 6354e2c8-5c5a-4407-8005-31f2c4065b3d {{(pid=94432) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 03 11:46:56.678424 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.712085 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3053421'] for subnet, precommit_delete_associations {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.721147 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.792861 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16394981'] for subnet, precommit_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.910012 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16394908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660686', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-260545826', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-260563280'] for subnet, after_delete {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.941221 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6354e2c8-5c5a-4407-8005-31f2c4065b3d,revision_number=None']} {{(pid=94432) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:56.942964 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron_lib.callbacks.manager [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94432) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:56.948396 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3afe5aaf-474e-4374-82b2-eac99df2748b None None] Network 9fa17f47-27d5-4019-b98b-7467310223cb requested from dv-cinder-760199-12-iscsi {{(pid=94434) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 03 11:46:56.948918 dv-cinder-760199-12-iscsi neutron-server[94432]: INFO neutron.wsgi [None req-b2139a35-dad0-4a2d-b684-7ad95c445f91 admin admin] 10.222.0.16 "DELETE /v2.0/subnets/6354e2c8-5c5a-4407-8005-31f2c4065b3d HTTP/1.1" status: 204 len: 168 time: 0.3197062 Sep 03 11:46:56.952844 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41950) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:57.022677 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16445422'] for network, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.086781 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Deleting port 82d41bf4-6007-4cdc-a525-e20fd70e24fd {{(pid=94433) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:57.087182 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.146300 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] DHCP port deletion for 9fa17f47-27d5-4019-b98b-7467310223cb request from dv-cinder-760199-12-iscsi {{(pid=94434) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 03 11:46:57.158596 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.db [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] For port 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=82d41bf4-6007-4cdc-a525-e20fd70e24fd,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94433) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:57.158962 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.173857 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.plugin [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Calling delete_port for 82d41bf4-6007-4cdc-a525-e20fd70e24fd owned by network:dhcp {{(pid=94433) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:57.193658 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Deleting port 82d41bf4-6007-4cdc-a525-e20fd70e24fd {{(pid=94434) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1921}} Sep 03 11:46:57.194034 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8726710622446'] for port, before_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.256618 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.db [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] For port 82d41bf4-6007-4cdc-a525-e20fd70e24fd, host dv-cinder-760199-12-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-760199-12-iscsi',level=0,port_id=82d41bf4-6007-4cdc-a525-e20fd70e24fd,segment=NetworkSegment(35040c03-8aa0-4bbb-a6ac-0e6940c99fc4),segment_id=35040c03-8aa0-4bbb-a6ac-0e6940c99fc4)] {{(pid=94434) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 03 11:46:57.257008 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780862'] for port, precommit_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.273234 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Calling delete_port for 82d41bf4-6007-4cdc-a525-e20fd70e24fd owned by network:dhcp {{(pid=94434) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1999}} Sep 03 11:46:57.314078 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 334d1c00-e0fa-457d-97d7-0bce0cd90b7d no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:57.326901 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2750979'] for port, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.344990 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 334d1c00-e0fa-457d-97d7-0bce0cd90b7d {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:57.345335 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 334d1c00-e0fa-457d-97d7-0bce0cd90b7d not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:57.345751 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 233c179b-0751-4151-a8dc-dae98a9614f4 no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:57.352143 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Pushing event deleted for resources: {'Port': ['ID=82d41bf4-6007-4cdc-a525-e20fd70e24fd,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:57.355627 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] No DVR routers for this DVR port 82d41bf4-6007-4cdc-a525-e20fd70e24fd on host dv-cinder-760199-12-iscsi {{(pid=94433) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:57.369604 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 233c179b-0751-4151-a8dc-dae98a9614f4 {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:57.370139 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 233c179b-0751-4151-a8dc-dae98a9614f4 not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:57.370250 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 82d41bf4-6007-4cdc-a525-e20fd70e24fd no longer exists at agent ovs-agent-dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 03 11:46:57.395793 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.plugin [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] No Port match for: 82d41bf4-6007-4cdc-a525-e20fd70e24fd {{(pid=94434) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2257}} Sep 03 11:46:57.396137 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.plugins.ml2.rpc [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Device 82d41bf4-6007-4cdc-a525-e20fd70e24fd not bound to the agent host dv-cinder-760199-12-iscsi {{(pid=94434) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 03 11:46:57.415514 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16347584', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-204518', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8726710630584', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8726710240633'] for port, after_delete {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.426756 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16391536', 'neutron.services.segments.db._delete_segments_for_network-8726710753877'] for network, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.437139 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9fa17f47-27d5-4019-b98b-7467310223cb']}} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:57.444336 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] Pushing event deleted for resources: {'Port': ['ID=82d41bf4-6007-4cdc-a525-e20fd70e24fd,revision_number=None']} {{(pid=94434) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:57.448304 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85c0853b-9795-467b-9f90-76f10daac291 None None] No DVR routers for this DVR port 82d41bf4-6007-4cdc-a525-e20fd70e24fd on host dv-cinder-760199-12-iscsi {{(pid=94434) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 03 11:46:57.455872 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4') {'for_net_delete': True} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:57.455872 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.services.segments.db [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '35040c03-8aa0-4bbb-a6ac-0e6940c99fc4') {} {{(pid=94433) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 03 11:46:57.464918 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8726710754910', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3381780'] for segment, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.479146 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156'] for segment, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.484909 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Releasing vlan 357 on physical network physnet1 to pool {{(pid=94433) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 03 11:46:57.485292 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16390156', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2751088'] for segment, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: Traceback (most recent call last): Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: timer() Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: cb(*args, **kw) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: return func(*args, **kwargs) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: self._notify() Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: self.callback(batched_events) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: event.method(event) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: aggregate_uuid = self.p_client.list_aggregates( Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: return f(self, *a, **k) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._get(url).json() Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: return self.request(url, 'GET', **kwargs) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: base_url = self.get_endpoint(auth, allow=allow, Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 03 11:46:57.486944 dv-cinder-760199-12-iscsi neutron-server[94433]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 03 11:46:57.583934 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16391527', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-660503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-530386', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-769317'] for network, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.589089 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-530368'] for network, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.591062 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] 10.222.0.16 "DELETE /v2.0/networks/9fa17f47-27d5-4019-b98b-7467310223cb HTTP/1.1" status: 204 len: 168 time: 0.6371281 Sep 03 11:46:57.602110 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd08c120-009b-4acd-af7a-0417bc644289 admin admin] Pushing event deleted for resources: {'Network': ['ID=9fa17f47-27d5-4019-b98b-7467310223cb,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:57.709709 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.858297 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41954) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:57.897100 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-2a352e88-3e9a-4f9d-9914-3ed40f4d3fcd admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=278d3bede8a94c32bc0dfdbdfb5259be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0375497 Sep 03 11:46:57.899275 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41956) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:57.949488 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:57.970758 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.093224 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.095745 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.096941 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/99806440-58e0-4541-9b25-8786e383379b HTTP/1.1" status: 204 len: 168 time: 0.1967912 Sep 03 11:46:58.105099 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b8b9a0-6c04-4f63-96be-b8c905c9cdb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99806440-58e0-4541-9b25-8786e383379b,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:58.715852 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41962) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:58.758383 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-d3944612-c7db-4bd1-a2d0-b097644cc044 admin admin] 10.222.0.16 "GET /v2.0/security-groups?tenant_id=60a05a95d23447fe8439542f0d2906db&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0413101 Sep 03 11:46:58.760763 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.wsgi [-] (94433) accepted ('10.222.0.16', 41964) {{(pid=94433) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 03 11:46:58.808082 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.828149 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.955304 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-683426'] for security_group, after_delete {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.958601 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron_lib.callbacks.manager [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94433) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:46:58.959780 dv-cinder-760199-12-iscsi neutron-server[94433]: INFO neutron.wsgi [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] 10.222.0.16 "DELETE /v2.0/security-groups/0e03ac02-3cd9-4cab-b9f0-54cc87d235c6 HTTP/1.1" status: 204 len: 168 time: 0.1981137 Sep 03 11:46:58.967946 dv-cinder-760199-12-iscsi neutron-server[94433]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a8136b7-c739-4b7f-a375-88ad23008f61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e03ac02-3cd9-4cab-b9f0-54cc87d235c6,revision_number=None']} {{(pid=94433) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 03 11:46:59.097565 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:07.936411 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:47:13.949483 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:23.685890 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2a28bf6b-3395-482c-a981-46b6727a59ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:26.343194 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-a5104557-69f4-43c9-90a7-8d6fe6ec236b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:26.714939 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:27.737613 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:29.137326 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:43.937264 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:44.935071 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:47:53.673487 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-2f3887c4-a479-4a51-aa15-547fafc4625f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:56.377126 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e842f198-f169-496c-839e-ecabcaf94622 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:56.714520 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:57.719952 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:47:59.108947 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:13.994231 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:21.933556 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:48:23.690889 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-b42588a1-4d7f-48ea-a9de-9f2006736c50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:26.342536 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-eb1c025c-5e64-476d-9ae5-4db6414f77d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:26.759317 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:27.713913 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:29.119262 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:43.953767 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:53.684429 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7bb4ca2d-cf8e-4953-84d6-675351de174b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:56.359668 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-7ae48a8c-b987-453e-9cf4-f49ddf6bf403 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:56.730192 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:57.718181 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:48:58.932115 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:48:59.170409 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:13.970874 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:23.678350 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-aa9256ee-36b7-42c2-8585-48a01eb47875 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:26.347132 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-6a12e011-a0ef-451e-bbd4-de44c8d37401 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:26.745830 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:27.718817 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:29.175812 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:35.930726 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:49:43.973879 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:53.689479 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e45904c7-7e7e-4937-bdc3-3ab8749ba1b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:56.363666 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-279d5fa7-801a-4de5-ac2f-eeb44a868b5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:56.729138 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:57.722069 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:49:59.163827 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:12.930868 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:50:13.991985 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:23.688978 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e82aaa46-b12b-4440-b4c2-9dd1e9e77c16 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:26.357697 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-481d06e8-1c85-48b1-a906-0e27e024b755 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:26.774761 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:27.733132 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:29.138679 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:44.008593 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:49.084117 dv-cinder-760199-12-iscsi neutron-server[94432]: DEBUG neutron.wsgi [req-4048103b-2d8e-4883-aa14-9290f85ceef4 req-2d8215bb-10a5-450c-bbc9-ce2d3185df98 tempest-AttachVolumeTestJSON-1767342361 tempest-AttachVolumeTestJSON-1767342361-project] (94432) timed out ('10.222.0.11', 57447) {{(pid=94432) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 03 11:50:49.930634 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:50:53.728582 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-84815dc1-f307-4318-b23c-03c9fbe4fed8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:56.356795 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ac8daa55-ee1b-48e0-912e-bc1b910506c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:56.739923 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:57.751564 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:50:59.162635 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:14.002302 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:23.682053 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-d1b78333-e36e-489e-a8c1-558d94ca1db0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:26.362076 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-22dde406-2903-4ce5-af8d-fa10106df7d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:26.744972 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:26.929991 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:51:27.733685 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:29.143035 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:44.030434 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:53.761516 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-ddbdb144-462e-43a5-baba-abcb35e78e18 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:56.376866 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-05a00fcf-3b84-4405-bd52-39d9fc21c0d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:56.754147 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-95774c54-0af2-48b0-a0e4-8487629f9bf9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:57.765069 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-78602002-d8e0-4c55-85ff-4497d5a67afc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:51:59.188518 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-e33fdf5d-f2ab-4f10-a20e-68c43c613826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 03 11:52:03.928656 dv-cinder-760199-12-iscsi neutron-server[94435]: DEBUG neutron.db.agents_db [None req-bc1dc25a-8a9f-4cf0-8a70-9d970c405666 None None] Agent healthcheck: found 6 active agents {{(pid=94435) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 03 11:52:13.995715 dv-cinder-760199-12-iscsi neutron-server[94434]: DEBUG neutron_lib.callbacks.manager [None req-573467bf-d223-4a34-acc4-e176467476e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8726710753859', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16389946'] for agent, after_update {{(pid=94434) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}